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INFORMATION  MANAGEMENT  PERFORMANCE  OF  FUTURE  PLATOON  LEADERS: 
AN  INITIAL  INVESTIGATION 


EXECUTIVE  SUMMARY 


Requirement: 

The  Army's  current  focus  on  precision  warfare  and  the 
nonlinear  battlefield  only  underscores  its  longstanding  need  for 
advanced  command  and  control  (C2)  capabilities.  Recent  combat 
experience  clearly  indicates  that  if  automated  C2  systems  are  to 
achieve  their  potential,  they  must  allow  users  to  extract  and 
process  quickly  the  battlefield  information  essential  to  their 
assigned  missions.  However,  the  advent  of  automated  C2  systems 
may  result  in  an  information  deluge  that  masks  essential  elements 
of  combat  information,  particularly  for  vehicle-based  commanders 
on  the  forward  edge  of  the  battlefield. 

Ongoing  efforts  to  "digitize  the  battlefield"  require  a 
clear  understanding  of  how  automated  C2  systems  will  be  used  and 
innovative  methods  of  training  and  assessing  the  management  of 
information.  Based  on  a  simulated  method  for  delivering  informa¬ 
tion  management  exercises,  this  report  investigated  the  informa¬ 
tion  management  performance  of  armor  platoon  leaders  using  auto¬ 
mated  C2  systems. 


Procedure: 

Participant  platoon  leaders  completed  a  series  of  informa¬ 
tion  management  exercises  that  systematically  varied  the  number 
and  relevance  of  messages  received  during  a  simulated  delay-in- 
sector  mission.  Performance  measures  included  information 
processing  accuracy  and  speed  and  the  type  of  actions  taken  on 
messages  received  during  each  exercise.  Additional  measures 
included  an  objective  measure  of  participants'  awareness  of  the 
battlefield  situations  portrayed  by  the  exercises  and  subjective 
measures  of  workload,  situational  awareness,  and  the  relative 
contributions  of  voice  versus  digital  communications  for  selected 
command,  control,  and  communication  functions. 


Findings: 

The  evaluation  demonstrated  that  information  amount  and 
relevance  had  significant  effects  on  the  information  management 
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performance  of  future  platoon  leaders  equipped  with  automated  C7 
systems.  When  participants  received  less  information,  they 
relayed  more  messages,  deleted  fewer,  and  plotted  reported  loca¬ 
tions  more  accurately.  When  participants  received  less  relevant 
information,  they  relayed  messages  more  slowly,  relayed  fewer 
messages,  deleted  and  took  no  action  on  more  messages,  and  were 
less  accurate  in  their  ability  to  "see"  the  battlefield. 

Relevance,  as  defined  by  message  locations  inside  versus 
outside  the  parent  unit's  assigned  sector,  proved  effective  for 
reducing  information  management  requirements.  Acting  as  informa¬ 
tion  filters,  the  participants  relayed  fewer  low  relevance  mes¬ 
sages  to  their  superiors  and  subordinates.  Similarly,  their 
relay  ratings  indicated  the  need  to  filter  out  low  relevance 
messages  for  their  own  duty  position.  The  results  indicate  that 
the  relevance  of  battlefield  information  is  a  key  factor  in 
reducing  information  amount. 

The  requirement  for  automated  C7  systems  was  evidenced  by 
the  participants'  ratings  on  the  assistance  such  systems  pro¬ 
vided.  Participants  preferred  automated  C7  systems  over  conven¬ 
tional  voice  communication  systems  for  a  variety  of  command, 
control,  and  communication  functions  rated  as  very  important. 
Conversely,  their  ratings  indicated  that  voice-based  systems  are 
superior  for  providing  message  urgency  and  feedback  on  message 
reception.  The  need  for  complementary  digital  and  voice  communi¬ 
cation  systems  was  clearly  indicated. 

With  respect  to  the  method  for  delivering  information 
management  exercises,  automated  recordings  of  message  distribu¬ 
tion  indicated  the  exercises  manipulated  information  amount  and 
relevance  as  intended.  Participants'  relay  ratings  on  the  mes¬ 
sages  received  confirmed  the  exercises  differentially  conveyed 
information  relevant  to  their  duty  position  and  to  their  supe¬ 
riors  and  subordinates.  The  method's  use  of  surrogate  communica¬ 
tors  to  simulate  transmissions  from  the  entire  battalion  task 
force  resulted  in  substantial  savings  in  personnel,  resources, 
and  equipment.  Potential  modifications  to  this  method  for 
enhancing  its  validity  and  generalizability  were  identified. 


Utilization  of  Findings: 

The  findings  provide  an  initial  indication  of  how  the 
information  management  performance  of  future  platoon  leaders  may 
be  affected  by  automated  C7  systems.  A  better  understanding  of 
how  information  amount  and  relevance  affect  the  management  of 
information  should  guide  the  development  of  training  methods  and 
programs  to  improve  the  performance  of  vehicle-based  users  of 
future  automated  C7  systems.  The  method  for  delivering  informa¬ 
tion  management  exercises  using  simulated  communications  can  be 
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tailored  to  meet  the  sometimes  conflicting  requirements  for 
soldier,  leader,  staff,  and  unit  readiness  in  active  and  reserve 
component  forces.  Such  readiness  may  be  required  to  win  the 
"information  war"  on  the  future  battlefield. 


IX 


INFORMATION  MANAGEMENT  PERFORMANCE  OF  FUTURE  PLATOON  LEADERS: 
AN  INITIAL  INVESTIGATION 


CONTFNTS _ 

Page 

INTRODUCTION  .  1 

Research  Requirement  .  1 

Description  of  a  Future  Command  and 

Control  System  .  3 

Assessment  Issues  .  5 

Assessment  Methods  .  7 

EVALUATION  OBJECTIVES  AND  HYPOTHESES  .  9 

Information  Management  Performance  .  10 

Information  Management  Exercises  .  10 

METHOD .  11 

Participants  . . .  11 

Apparatus .  11 

Experimental  Design  .  12 

Measures  .  13 

Procedure .  15 

RESULTS .  17 

Group  Equivalence .  18 

Understanding  of  Platoon  Leader  Information 

Requirements  .  18 

Message  Processing  Accuracy  .  19 

Message  Processing  Speed  .  23 

Message  Processing  Actions  .  25 

Situational  Awareness  .  27 

Ancillary  Measures  .  29 

Method  Checks  on  Information  Management  Exercises  ...  30 

DISCUSSION .  32 

Group  Equivalence .  3  3 

Message  Processing  Accuracy  .  34 

Message  Processing  Speed  .  35 

Message  Processing  Actions  .  ,  .  37 

Situational  Awareness  .  39 

Ancillary  Measures  .  40 

Method  Checks  on  Information  Management  Exercises  ...  40 

xi 


CONTENTS  (Continued)  , 


Page 

CONCLUSIONS .  41 

REFERENCES .  4  3 

APPENDIX  A.  SAMPLE  CONTROLLER ' S  LOG  .  A-l 

B.  TEST  MESSAGE  SETS  FOR  PLATOON  LEADERS  ....  B-l 

C.  SITUATIONAL  AWARENESS  MEASURES  .  C-l 

D.  SCORING  GUIDELINES  FOR  SITUATIONAL 

AWARENESS  MEASURES  .  D-l 

E.  ANCILLARY  MEASURES  .  E-l 

F.  TRAINING  AND  TESTING  SCHEDULE . F-l 

G.  SAMPLE  OPORD  EXTRACT  .  G-l 

H.  SUMMARY  DATA  ON  INFORMATION  MANAGEM  *T 

PERFORMANCE . .  .  .  H-l 

LIST  OF  TABLES 

Table  1.  Features  of  the  Command  and  Control  Display  .  5 

2.  Message  Elements  Used  in  Information 

Management  Exercises  .  8 

3.  Situational  Awareness  Items  .  14 

4.  Source  Table  on  Group  Equivalence  by 

Information  Amount  .  19 

5.  Mean  Relay  Ratings  (and  SDs)  by  Platoon 
Leaders  (PLs)  and  Company  Commanders  (CCs) 

on  Relay  To  and  Relay  By  Categories .  20 

6.  Interrater  Agreement  of  Platoon  Leaders 

and  Company  Commanders  on  Platoon  Leader 
Information  Requirements  by  Message  Set  ...  20 

7.  Source  Table  on  Inaccuracies  in  Message 
Processing  by  Information  Amount,  Relevance, 

and  Type  of  Error  (Over  and  Under  Relay)  ...  23 

xii 


Page 


Table 


Figure 


8.  Source  Table  on  Speed  of  Message  Processing 


by  Information  Amount  and  Relevance  .  26 

9.  Source  Table  on  Situational  Awareness 

Measures  by  Information  Amount,  Relevance, 

and  Situation .  30 


10.  Mean  Importance  of  Selected  Command, 

Control,  and  Communication  Functions  and 

Preferred  Mode  (Voice  or  CCD)  Based  on 

Assistance  Provided  .  31 


LIST  OF  FIGURES 

1.  Command  and  Control  Display  with  digital 
terrain,  overlay,  Spot  report,  and  SEND 


function  selected  .  4 

2.  Message  processing  accuracy:  Mean 
percentage  of  relay  errors  based  on 

company  commander  relay  ratings  .  22 

3.  Message  processing  speed  for  receive 
queue  relays  by  information  amount  and 

relevance .  25 


4.  Message  processing  actions  in  the  receive 

queue  by  information  amount  and  relevance  .  .  27 

5.  Situational  awareness  percentages  for 
plotting  and  seeing  by  information 

amount  and  relevance .  2  9 


xiii 


Information  Management  Performance  of  Future  Platoon  Leaders: 

An  Initial  Investigation 


Introduction 

’•The  command  and  control  process  must  discriminate,  from  the 
flood  of  information  available,  those  elements  essential  to  the 
commander  to  enable  him  to  make  timely  decisions”  (Department  of 
the  Army,  1985,  Field  Circular  71-6,  p.  2-2).  The  advent  of 
automated  command  and  control  ( C2)  systems,  however,  may  result 
in  an  information  deluge  that  masks  essential  elements  of  combat 
information.  Particularly  for  vehicle-based  commanders  on  the 
forward  edge  of  the  battlefield,  the  revolutionary  capabilities 
of  automated  C2  systems  to  digitize  communications  may  intensify 
the  requirement  to  manage  battlefield  information. 

The  intent  of  the  present  research  was  to  assess  the 
information  management  performance  of  future  platoon  leaders 
equipped  with  future  C2  systems.  This  effort  focused  on  the 
platoon  leader's  ability  to  acquire  and  communicate  battlefield 
information  using  a  vehicle-based  C2  system.  In  support  of  this 
effort,  prototype  methods  for  the  simulated  delivery  of  platoon 
leader  information  management  exercises  were  developed. 

Research  Requirement 

The  Army's  current  focus  on  precision  warfare,  the  nonlinear 
battlefield,  multinational  contingency  operations  and  reduced 
forces  only  underscores  its  long-standing  requirement  for 
advanced  C*  capabilities  (Foss,  1991) .  Recent  combat  experience 
clearly  indicates  that  if  automated  C2  systems  are  to  achieve 
their  potential,  they  must  allow  users  to  extract  and  process 
quickly  the  battlefield  information  ee=ential  to  their  assigned 
missions  (Burkett,  1991;  Foley,  1991;  Giboney,  1991). 

Armor  leads  the  development  of  automated  C2  systems  for 
ground  combat  vehicles.  Armor's  operational  concept  of  an 
automated  C2  system  for  the  Abrams  main  battle  tank  identifies 
its  potential  for  improving  command  and  control  performance  while 
acknowledging  its  profound  impact  on  command  and  control 
procedures  (U.S.  Armor  Center,  1992).  This  operational  concept 
describes  how  tactical  commanders  at  each  battalion  echelon  might 
use  such  systems  in  the  conduct  of  combat  operations. 

To  support  Armor's  requirement  for  automated  C2  systems,  the 
Army  Research  Institute  (ARI)  at  Fort  Knox  participates  in  a 
research  and  development  program  on  future  Combat  Vehicle  Command 
and  Control  (CVCC)  systems  under  the  sponsorship  of  the  Tank 
Automotive  Command  (TACOM) .  As  the  Simulation  and  Soldier- 
Machine-Interface  team  for  this  CVCC  program,  ARI  conducts 
simulation-based  research  on  future  C*  system  configurations  and 
their  training  requirements  using  the  Mounted  Warfare  Test  Bed 
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MWTB)  at  Fort  Knox,  formerly  SlMulation  NETworking  Developmental 
(SIMNET-D) . 

The  MWTB's  distributed  simulation  technology  (Chung,  Dickens, 
O'Toole,  &  Chiang,  1987;  Pope,  1987)  provides  a  powerful  test  bed 
for  soldier-in-the-loop  assessment  of  developmental  systems,  and 
particularly  systems  related  to  command  and  control  performance 
(Alluisi,  1991).  Simulators  in  the  MWTB  serve  as  reconf igurable 
weapon  systems  that  emulate  the  features,  capabilities  and 
soldier-machinr-  interfaces  anticipated  for  developmental  systems. 
This  evaluation  used  Ml  tank  simulators  in  the  MWTB  configured 
with  automated  e*  systems  under  the  CVCC  program. 

Research  conducted  in  the  MWTB  has  primarily  targeted  the 
effect  of  automated  C2  systems  on  unit-level  performance  during 
simulated  combat  operations.  ARI-Knox's  supporting  efforts  in 
the  MWTB  include  automated  C2  evaluations  at  the  platoon,  company 
and  battalion  level  (Du  Bois  t  Smith,  1991;  Leibrocht  et  al., 
1992;  O'Brien  et  al.,  1992).  Currently,  the  Mounted  Warfighting 
Battlespace  Lab  is  extending  ARl's  tank-based  program  to  other 
branches  such  as  infantry,  artillery,  and  air  defense  in  an 
effort  to  integrate  horizontally  all  combined  arms  through 
"digitization"  of  the  battlefield.  These  unit-level, 
operationally-based  assessments  have  raised  the  need  for 
complementary  efforts  to  investigate  selected  C2  research  issues, 
such  as  information  management,  in  a  more  limited  but  systematic 
manner. 

Despite  the  shortcomings  associated  with  conventional  C2 
systems,  a  transition  to  more  automated  C2  systems  involves  many 
trade-offs  (Burkett,  1991;  Giboney,  1991)  including  the  potential 
for  increased  workload  and  decreased  information.  In  a  workload 
assessment  of  the  CVCC  system,  for  example,  commanders  expressed 
concern  that  voice-less  reporting  might  increase  their  workload 
on  tasks  such  as  preparing  Contact,  call  For  Fire,  and  Spot 
reports  (Morey,  Wigginton  &  O'Brien,  1992) .  In  contrast  to 
digital  reporting  systems,  auditory  recognition  with  voice-based 
systems  may  reinforce  cues  such  as  information  source  that  aid  in 
relaying  reports  correctly  (Emery  and  Lickteig,  1991) . 

This  evaluation  investigated  the  effects  an  automated  C2 
system  may  have  on  the  information  acquisition  and  communication 
performance  of  an  armor  platoon  leader.  Widespread  concerns 
suggest  such  systems  may  overwhelm  the  ability  of  tactical 
commanders  to  manage  information  (Burkett,  1991;  Foley,  1991; 
Giboney,  1991) .  The  evaluation's  design,  therefore,  varied  the 
amount  and  relevance  of  information  a  platoon  leader  was  required 
to  process  in  a  typical  combat  setting.  Primary  measures 
addressed  platoon  leaders'  information  management  performance 
based  on  accuracy,  speed  and  action  taken  on  incoming  battlefield 
reports  and  their  ability  to  assess  the  battlefield  situation 
described  by  these  communications. 
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A  brief  description  of  the  prototype  C*  eysten  used  in  this 
evaluation  nay  illustrate  the  information  management  requirements 
of  future  small  unit  commanders  in  acquiring  and  communicating 
battlefield  information.  A  more  complete  description  of  this 
interface;  the  Command  and  Control  Display  (CCD);  and  its 
integration  with  other  CVCC  component  systems  is  available  in 
LaVine,  Lickteig  and  Schmidt  (1993). 

The  CCD  (see  Pigure  1)  provides  a  wide  range  of  features  to 
aid  commanders  such  as  platoon  leaders  in  the  performance  of 
their  command  and  control  tasks.  The  CCD  integrates  information 
exchanges  among  on-board  and  intervehicular  systems.  Tank 
components  such  as  navigation  and  fire  control  provide  internal 
linkages  with  the  CCD  interface.  External  communications  of  CCD 
reports  and  overlays  to  similarly  equipped  vehicles  and  stations 
are  sent  and  received  using  a  Single  Channel  Ground/Air  Radio 
System  (8INCGARS)  coupled  with  a  radio  Interface  unit.  The  CCD 
information  management  featuros  used  in  the  current  evaluation 
are  indicated  in  Table  1. 

A  primary  objective  of  the  CCD's  Integrated  architecture  ie 
to  provide  each  commander  an  accurate  picture  of  the  battlefield 
situation  (LaVine  et  si.,  1993).  A  sample  depletion  of  the  CCD's 
battlefield  situation  is  provided  in  rigurc  l.  This  illustration 
includes  n  tactloal  sap  of  the  area  based  on  a  digital-terrain 
data  base,  operational  overlay,  icons  of  own,  friendly  and  enemy 
vehiolee,  and  a  preformatted  Spot  report. 

The  CCD  automatically  displays  report-based  graphic 
information  on  its  tactical  map  to  maintain  an  accurate  portrayal 
of  the  current  battlefield  situation.  Por  example,  an  incoming 
Intelligence  report  might  contain  friondly,  enemy  and  obstacle 
information.  Ae  this  report  la  racsived,  tha  CCD  gonarates  icons 
on  the  tactloal  map  for  aach  of  theaa  raport  alemente.  The  ioone 
are  color-coded,  standard  military  symbols  automatically 
positioned  at  their  reported  locations.  Similarly,  own  and 
friendly  vehicle  icons  are  routinely  repositioned  on  tha  tactloal 
map  as  tha  CCD  recaivas  location  updatas  from  friendly  vehicles 
on  the  move. 

To  alert  the  user  to  the  reception  of  new  information,  tha 
CCD  generates  aural  signals  (beeps)  in  the  ussr's  hsadsot  and 
visual  signals  to  Include  flashing  rsport  icons  and  a  highlightod 
RECEIVE  key.  User  activation  of  ths  RECEIVE  key  accesses  ths 
Receive  Queue,  a  list  of  the  most  recently  received  mossagos. 

Each  message  "header"  In  this  queue  provides  information  on 
message  source  and  type  as  well  as  recaption  tins.  When  multiple 
message  headers  appear,  the  commander  may  decide  how  and  in  what 
order  to  process  reports  by  reviewing  headers  in  conjunction  with 
report-icon  type  and  proximity  information  displayed  on  the 
tactical  map. 
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Figure  1.  Command  and  Control  Display  with  digital  terrain, 
overlay,  Spot  report,  and  SEND  function  selected, 

The  user's  selection  of  a  message  header  highlights  its 
corresponding  report  loon  on  the  tactical  map  and  identifies  the 
message  to  be  processed.  After  reading  a  message,  the  commander 
can  delete,  store  or  relay  the  message  on  the  combat  radio  nets 
allotted  to  his  respeotive  duty  position,  Platoon  leader  relays 
on  the  company  net  are  broadcast  to  his  company  commander  and 
executive  officer  as  well  as  the  company's  other  two  platoon 
leaders.  Similarly,  relays  on  the  platoon  net  are  transmitted  to 
the  three  tank  commanders  in  his  platoon. 

As  evidenced  in  this  brief  description,  the  information 
management  requirements  for  automated  C*  syetems  are  quite 
different  from  the  proceduree  currently  used  with  conventional 
command  and  control  eyatema  based  or  voles- radio,  great**  psnclls 
and  sostats  ovsrlays  (U.S.  Armor  Center,  1992).  CCD  information 
managsmsrit  skills  for  acquiring  and  communicating  battlefield 
information  include  knowledge  of  the  procedures  to  retrieve  and 
relay  CCD-based  information  (Atwood  at  al.,  1991).  Proper 
management  of  the  CCD's  information  processing  capabilities, 
however,  may  provldo  the  commander  s  unique  capability  to 
communicate  required  information  to  his  superiors  and 
subordinates  ai,d  at  the  same  time  visual irs  the  emerging 
battlefield  situation. 
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Table  1 


Features  of  the  Command  and  Control  Display 


Digital-terrain  map* 

Map  scale,  scroll,  and  feature  manipulation* 

Own-vehicle  location  and  heading  (analog  &  digital  format)* 
Friendly  locations  at  vehicle  or  unit  level* 

Route  designation 
Route  transmission 

Driver's  display  showing  direction  to  steer  the  tank 
Far-target  designation  into  digital  report  formats 
Report  icons  and  icon-based  report  retrieval* 

Digital  report  preparation 

Digital  report  transmission  and  reception* 

Digital  overlay  transmission  and  reception 


*  Features  used  in  this  evaluation. 

Assessment  Issues 

A  primary  concern  in  the  assessment  of  soldier  performance, 
including  information  management,  is  the  balance  between 
standardized  conditions  and  operational  realism.  Standardization 
problems  in  training  and  assessing  even  small  unit  tactical 
performance  are  well  documented  (R.  A.  Baker,  Cook,  Warnick  and 
Robinson,  1964;  Barron  et  al.,  1976;  Drucker  and  Morrison,  1987; 
R.  E.  O'Brien,  1986;  Schwartz  and  Floyd,  1963).  A  vehicle-based 
commander's  information  management  performance,  for  example, 
depends  on  many  ad  hoc  factors  in  a  force-on-forca  operation 
including  the  direction,  speed  and  formation  of  own  and  opposing 
units.  Battlefield  simulation,  however,  can  readily  support  the 
generation  and  standardization  of  tactical  task  conditions 
(Qoldstein,  1991) . 

Early  efforts  in  the  assessment  of  tactical  information 
processing  devised  strategies  to  standardize  information 
processing  requirements.  Such  strategies  included  the 
development  of  more  direct  measures  of  information  processing  and 
the  use  of  "probe"  messages  (Olmstoad,  Christensen  and  Lackey, 
1973),  models  for  quantifying  soldier  performance  in  information 
systems  (J.  D.  Baker,  1970),  and  simulation  models  of  soldier- 
machine  Interaction  (Siegel,  Wolf,  Leahy,  and  Bearde,  1977). 

Most  efforts  to  assess  information  management  in  a  military 
contoxt  have  addressed  staff  or  command  post  performance  rather 
than  vehicle -based  tactical  commanders  (Crumley,  1989).  One 
pertinent  finding  was  that  a  staff's  ability  to  communicate 
information  is  the  primary  determinant  of  their  organizational 
effectiveness  (Olmstead,  Christensen  and  Lackey,  1973).  However, 
shortcomings  in  command  and  staff  information  processing 
demonstrate  that  personnel  are  frequently  unable  to  acquire  and 
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communicate  needed  information  (Kaplan,  1987) .  A  prevailing 
concern  is  the  relevance  of  the  information  staff  and  commanders 
are  required  to  manage  (e.g.,  Kaplan,  1980;  Shoffner,  1993). 

While  there  are  fundamental  differences  in  staff  versus 
vehicle-based  C2  procedures,  the  same  C2  functions  are  executed 
by  every  Army  leader  using  the  system  available.  The  C2  process 
requires  acquiring  information,  assessing  its  impact,  determining 
a  course  of  action  and  directing  its  execution.  "The  information 
is  sent  and  received,  the  means  of  communicating  the  information 
managed,  and  the  information  maintained  in  a  form  convenient  to 
the  decision-making  process"  (Department  of  the  Army,  1990,  p. 

24) .  Many  of  the  assessment  issues  related  to  these  functions 
are  identical  regardless  of  setting  or  unit  level. 

For  small  unit  information  management,  more  realistic 
assessments  from  the  National  Training  Center  (NTC)  indicate 
serious  shortcomings  using  conventional  C2  systems  that  are 
voice-based.  Data  from  NTC  company-level  missions  revealed  that 
net  overload  results  in  almost  30-second  waits  to  access  a  net, 
that  call  signs  and  authentication  procedures  account  for  over 
one-half  of  the  "information"  transmitted,  and  nearly  one-third 
of  all  messages  are  lost  due  to  interference  (Phelps  and  Kupets, 
1984).  Such  information  management  problems  may  account  for 
Word's  (1987)  observation  that  one  of  the  greatest  small  unit 
deficiencies  at  the  NTC  is  the  inability  of  the  platoon  leader  to 
assess  the  battlefield  situation. 

The  commander's  ability  to  "see"  the  battlefield  is  regarded 
as  one  the  most  fundamental  skills  underlying  his  planning, 
preparation  and  execution  of  the  battle.  This  ability  is 
commonly  referred  to  as  situational  awareness,  a  difficult 
construct  to  define  or  measure  (Sarter  and  Woods,  1991)  despite 
recent  efforts  (Endsley,  1988;  Fracker,  1988).  Endsley  defines 
situational  awareness  as:  "...the  perception  of  the  elements  in 
the  environment  within  a  volume  of  space  and  time,  the 
comprehension  of  their  meaning,  and  the  projection  of  their 
status  in  the  near  future"  (Endsley,  1988,  p.  97).  A  parallel 
construct  is  the  tactical  C2  Battlefield  operating  System 
function  titled  Assess  the  Situation  (Department  of  the  Army, 
1990) . 

Situational  assessment  and  awareness  measures  require 
consideration  of  the  current  and  future  battlefield  situation. 

In  addition,  an  objective  measure  of  the  commander's  awareness  or 
assessment  of  the  situation  requires  accurate  knowledge  of  the 
actual  battlefield  situation  (Endsley,  1988;  Fraoker,  1988; 

Sarter  and  Woods,  1991). 

Finally,  a  major  obstacle  in  the  assessment  of  voice-based 
communications  with  conventional  systems  is  the  need  to  record 
and  transcribe  battlefield  communications.  Voice  data  capture  is 
a  time-consuming,  inaccurate  and  resource  intensive  process 
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(e.g.,  Phelps  and  Kupets,  1984).  For  field-based  assessments, 
data  collection  and  reduction  systems  for  voice  and  digital 
communications  are  under  development  (Palmer,  1992).  For 
simulation-based  assessments  such  as  those  conducted  by  ARI  in 
the  MWTB,  the  Data  Collection  and  Analysis  (DCA)  system  captures 
all  battlefield  communications  transmitted  over  the  Ethernet 
during  simulated  combat  operations.  The  digital  report  formats 
used  by  automated  C2  systems  such  as  the  CCD  enable  accurate 
capture  of  communications  and  much  of  the  information  management 
performance  of  vehicle-based  commanders  (Leibrecht  et  al.,  1992). 

Assessment  Methods 

The  potential  of  computer-based  C2  systems  and  soldier-in- 
the-loop  combat  simulations  support  the  development  of  new 
methods  for  assessing  command  and  control  performance  (Du  Bois  & 
Smith,  1990) .  The  assessment  methods  developed  for  this 
evaluation  with  the  aid  of  armor  Subject  Matter  Experts  (SMEs) 
are  briefly  described  in  this  and  the  Procedure  section.  These 
methods  include  a  set  of  information  management  exercises  and 
situational  assessment  measures  targeted  at  future  platoon  leader 
information  management  requirements. 

Information  Management  Exercises.  Development  of  the 
information  management  exercises  for  this  evaluation  began  with  a 
review  of  the  functions  and  tasks  for  "acquire  and  communicate 
information"  as  specified  in  the  tactical  C2  Battlefield 
Operating  System  (Department  of  the  Army,  1990) .  Platoon  leader 
tasks  were  reviewed  (Department  of  Army,  1988)  including  a 
mission-based  analysis  of  the  information  to  be  acquired  and 
communicated  by  this  duty  position  (Drucker  and  O'Brien,  1982). 

In  an  effort  to  standardize  conditions,  the  exercises  used  a 
vignette  structure  to  generate  an  operational  "snapshot"  that 
realistically  includes  a  flurry  of  battlefield  communications  and 
provides  discrete  start  and  stop  points.  Based  on  a  delay-in- 
sector  mission,  each  exercise  began  with  the  postulated 
completion  of  a  successful  delay  by  the  platoon  leader's  company 
and  terminated  prior  to  his  ordor  to  displace  to  a  subsequent 
battle  position  (BP) .  The  duration  of  each  exercise  was  set  at 
10  minutes.  In  this  operational  setting,  the  platoon  leader 
serves  as  a  vital  link  in  the  information  chain  between  lower  and 
higher  units  and  as  a  unit  leader  assessing  the  impact  of 
incoming  information  on  his  imminent  order  to  displace. 

For  each  exercise,  a  prespecified  message  set  comprised  the 
primary  information  to  be  acquired  and  communicated  by  the 
platoon  leader.  In  general,  each  set  of  messages  described  the 
enemy's  delay  by  the  platoon  leader's  task  force  and  provided 
information  pertinent  to  the  platoon's  upcoming  displacement  to  a 
subsequent  battle  position.  Message  sets  included  Contact,  Spot, 
and  Intelligence  reports  in  formats  available  on  the  CCD  that 
provided  the  informational  elements  identified  in  Table  2. 
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Table  2 

Message  Elements  Used  in  Information  Management  Exercises 


Type 

From 

What 

Number/Status 
Obs  Dam  Des 

Where 

Dir 

Activity 
En  Fr 

AS  Of 

Contact  x 

X 

X 

X 

Spot 

X 

X 

X  X 

X 

X 

X 

X 

X 

Intel 

X 

X 

X 

X 

X 

X 

X 

X 

Note. 

X  *  element  available  in  CCD 

report 

format;  obs  » 

observed;  Dam  -  damaged;  Des  -  destroyed;  Dir  «  direction; 

En  -  enemy;  Fr  ■  friendly;  As  Of  ■  minutes  postdated. 

Message  content  included  information  from  lover,  higher  and 
adjacent  units.  This  information  had  potential  importance  to  the 
platoon  leader,  his  subordinates  and  his  superiors. 

To  assess  information  acquisition  and  communication 
performance  over  differing  situations  and  conditions,  the 
exercises  varied  battlefield  location,  threat  type  and  course  of 
action,  and  information  amount  and  relevance.  The  postulated 
enemy  unit  for  each  exercise  was  a  motorized  rifle  or  tank 
reg.  lent  in  deliberate  attack  against  the  platoon  leader's  task 
force.  For  message  sets  with  different  levels  of  information 
amount  and  relevance,  the  enemy  units  directly  approaching  the 
platoon  leader's  battle  position  varied  in  size  and  course  of 
action. 

After  deve!oproent  of  the  message  sets,  they  vers  loaded  on  a 
software  utility  in  the  MWTB  called  SEND  that  is  designed  to 
transmit  CCD-based  message  formats  to  the  CVCC  simulators. 

SEND  modifications  supported  the  simultaneous  assessment  of 
multiple  platoon  leaders,  counterbalancing  the  order  of  message 
set  transmission,  and  the  "isolation"  of  each  platoon  leader  from 
coparticipant  transmissions.  A  SEND  routine  generated  fixed- 
interval  pauses  between  messages  to  ensure  transmission  of  all 
messages  during  the  first  nine  minutes  of  the  exercise. 

By  simulating  message  transmissions  from  the  other  members  of 
the  battalion  task  force,  potentially  57  other  vehicle  and  unit 
commanders  plus  staff,  conduct  of  the  information  management 
exercises  required  only  platoon  leader  personnel.  As  developed, 
the  exercises  enable  an  accurate  trace  of  combat  communications 
across  radio  nets  and  echelons  as  well  as  the  information 
management  performance  of  participants.  This  assessment  of 
information  flow  is  regarded  as  one  of  more  successful  methods 
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employed  In  C2  assessment  (Solick  and  Lussier,  1988).  In 
summary,  the  simulation-based  nature  of  the  information 
management  exercises  standardized  the  rapid  generation  and 
variation  of  battlefield  conditions  and  communications. 

Situational  Awareness.  Based  on  the  model  proposed  by 
Endsley  (1988),  the  situational  awareness  measures  developed  for 
this  evaluation  addressed  the  platoon  leader's  current  and  future 
battlefield  situation  for  each  of  the  information  management 
exercises  developed.  As  the  primary  determinant  of  the 
battlefield  situation,  the  message  sets  for  each  exercise 
provided  a  firm  basis  for  scoring  participants'  responses  on  the 
situational  awareness  measures. 

A  major  concern  in  the  assessment  of  situational  awareness 
(Sarter  and  Woods,  1991)  is  to  avoid  disruption  of  the  situation 
by  "freezing"  the  operational  setting  in  order  to  collect 
situational  awareness  data.  On  the  other  hand,  Sarter  and  Woods 
warn  that  after-the-fact  data  collection  may  reduce  contextual 
information  that  might  trigger  unconscious  aspects  of  awareness. 
Finally,  they  caution  that  post  hoc  assessments  may  actually 
distort  one's  awareness,  particularly  in  the  cas^  of  extended 
operations. 

In  an  effort  to  avoid  distortion  in  platoon  leader  awareness, 
the  information  management  exercise  method  provided  capsulized 
rather  than  extended  operational  situations.  In  addition,  the 
situational  awareness  measures  for  this  evaluation  were 
administered  immediately  after  completion  of  the  information 
management  exercises  to  avoid  intrusion  into  the  battlefield 
situation  and  the  loss  of  contextual  information.  The 
development  of  these  measures  attempted  to  emulate  the  task 
context  to  aid  information  retrieval  (Lord  and  Maher,  1991) .  For 
example,  color  maps  of  the  digitized  battlefield  area  similar  to 
the  CCD's  tactical  map  were  provided  along  with  black-and-white 
xeroxed  copies  the  participants  used  to  plot  the  requested 
locations. 


Evaluation  Objectives  and  Hypotheses 

The  primary  objective  of  the  evaluation  was  to  obtain 
preliminary  data  on  the  ability  of  platoon  leaders  to  manage 
battlefield  information  using  a  future  automated  C2  system. 

A  secondary  objective  was  to  ensure  that  the  method  developed  for 
delivering  information  management  exercises  operated  as  expected. 

Although  automated  C2  systems  are  regarded  as  a  key  component 
in  winning  the  "information  war"  on  the  future  battlefield,  their 
potential  for  information  overload  is  a  growing  concern. 
Simulation-based  assessments  of  these  systems  have  demonstrated 
significant  improvement  in  command  and  control  performance  for 
units  equipped  with  automated  C2  systems.  However,  no  systematic 
assessment  of  information  load  and  relevance  on  the  information 
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management  performance  of  vehicle-based  commanders  with  automated 
C2  systems  has  been  conducted. 

Information  Management  Performance 

Hypotheses  on  the  information  management  performance  of 
participant  platoon  leaders  were  categorized  by  accuracy,  speed 
and  actions  taken  on  messages  processed  as  well  as  participants' 
awareness  of  the  battlefield  situation  conveyed  by  each  message 
set.  Hypotheses  were  based  on  the  logical  assumptions  that 
higher  numbers  of  messages  would  overwhelm  participants'  ability 
to  effectively  and  efficiently  manage  the  information  received 
and  that  more  relevant  information  would  motivate  more  effective 
and  efficient  information  management. 

It  was  hypothesized  that  participants  receiving  fewer 
messages  would  be  more  accurate  and  faster  in  their  overall 
ability  to  process  messages  received.  It  was  also  predicted  that 
low  amount  participants  would  relay  and  take  action  on  more 
messages,  delete  fewer  messages  and  demonstrate  a  better 
awareness  of  their  battlefield  situation.  With  respect  to 
information  relevance,  it  was  predicted  that  low  relevance 
message  sets  would  be  processed  less  accurately  and  more  slowly. 
It  was  also  predicted  that  when  participants  received  low 
relevance  message  sets,  they  would  relay  fewer  messages,  delete 
and  taka  no  action  on  more  messages  and  demonstrate  less 
awareness  of  their  battlefield  situation. 

For  ancillary  measures  involving  subjective  data,  it  was 
predicted  that  participants  receiving  fewer  messages  would  rate 
their  workload  lower  and  situational  awareness  higher.  It  was 
also  predicted  that  more  relevant  message  sets  would  result  in 
higher  situational  awareness  ratings.  Participant  ratings  of  the 
assistance  provided  by  the  CCD  versus  voice-based  command  and 
control  systems  were  expected  to  underscore  the  complementary 
nature  of  these  systems  for  assisting  commanders  in  performing 
important  information  management  requirements. 

Inf  pmatipn  -Management  -Bxerslggg 

The  method  used  to  deliver  the  information  management 
exercises  for  this  evaluation  employed  simulated  CCD-based 
communications  and  relied  primarily  on  a  communications  utility 
called  SEND  available  in  the  Maneuver  Warfare  Test  Bed.  Method 
checks  are  reported  for  two  reasons.  First,  to  ensure  this 
method  resulted  in  standardized  manipulations  of  information 
amount  and  relevance  as  required  for  this  evaluation.  Second,  to 
provide  information  on  the  applicability  of  this  method  for 
subsequent  training  and  assessment  efforts  related  to  information 
management  performance  with  automated  C2  systems. 

To  verify  the  method's  manipulation  of  information  amount,  a 
series  of  checks  were  expected  to  demonstrate  that  participants 
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received  all  messages  designated  for  their  assigned  radio  net  and 
amount  condition,  and  that  no  additional  messages  were  received. 
Additional  messages  might  result  from  net  "bleedover"  during 
simultaneous  transmissions  to  coparticipants  or  failure  of  the 
"isolate"  mode  to  prevent  reception  of  messages  relayed  by 
coparticipants.  This  assessment  also  included  checks  on 
differential  transmission  rates  for  low  versus  high  amount 
conditions. 

To  assess  the  manipulation  of  information  relevance,  it  was 
expected  that  experimenter  checks  of  message  locations  plotted  on 
the  CCD's  tactical  map  would  concur  with  designated  in-sector 
versus  out-of-sector  company  boundaries.  In  addition,  it  was 
predicted  that  participants'  ratings  on  the  need  to  relay  the 
test  messages  would  be  significantly  higher  on  the  high  relevance 
message  sets. 


Method 


Participants 

Participants  for  this  evaluation  were  16  platoon  leaders  who 
were  active  duty  armor  officers  stationed  at  Port  Knox.  On  the 
average,  these  participants  were  27  years  old  with  4  years  of 
Army  service  and  1.2  years  in  armor.  Overall,  this  sample  was 
comprised  of  2nd  Lieutenants  recently  graduated  from  the  Armor 
Officer  Basic  Course  (AOBC)  with  an  average  of  2.5  months  platoon 
leader  experience.  Unless  otherwise  indicated,  all  findings 
reported  are  based  on  this  sample  of  platoon  leader  participants. 

Raters  for  this  evaluation  were  12  company  commanders  who 
were  active  duty  armor  officers  stationed  at  Fort  Knox.  On  the 
average,  these  raters  averaged  over  4  years  in  armor  and  17.1 
months  prior  service  as  platoon  leaders.  These  raters  served  as 
subject  matter  experts  (SMEs)  for  determining  platoon  leader 
information  requirements.  They  provided  comparison  data  to 
assess  how  well  the  relatively  inexperienced  sample  of  platoon 
leader  participants  understood  the  information  requirements  for 
their  duty  position.  Anonymity  was  ensured  for  all  participants 
and  raters. 

Apparatus 

The  evaluation  was  conducted  in  the  MWTB  and  relied  on  the 
simulation  technologies  available  in  this  test  bed  including  the 
CVCC  simulators.  In  each  of  four  CVCC  simulators,  the  CCDs  were 
mounted  right  of  the  vision  blocks  in  the  platoon  leader's  weapon 
station.  The  CCD  provided  all  message  reception  and  processing 
features  required  for  managing  the  information  received  during 
each  exercise.  The  CCD  interface  was  projected  on  a  13-inch  (33 
cm),  color,  cathode  ray  tube  monitor  with  high  resolution  (1,250 
x  1,024  pixels)  and  a  touch-sensitive  screen.  The  display  itself 
occupied  a  rectangular  region  (7  x  5.75  inch,  17.8  x  14.6  cm)  in 
the  lower  right  corner  of  the  monitor. 
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Each  tank  simulator's  host  processor  generated  battlefield 
imagery  to  include  own  and  other  participant  vehicles  colocated 
on  the  current  battle  position  for  each  exercise.  The  SINCGARS 
radio  in  each  simulator  received  and  transmitted  the  reports  for 
each  exercise  over  an  Ethernet  that  linked  all  simulators  with 
the  exercise  control  room  and  the  Data  Collection  and  Analysis 
system. 

Supporting  MWTB  utilities  in  the  exercise  control  room  were 
control  consoles  for  initializing  the  simulators  at  the 
designated  battlefield  locations  for  each  exercise,  a  plan-view 
display  for  monitoring  the  exercise,  and  a  SINCGARS  and  SEND 
station.  The  controller's  SINCGARS  provided  a  voice-digital  link 
to  each  simulator  to  prompt  exercise  initiation  and  completion. 
The  SEND  terminal  transmitted  the  operational  overlays  and  the 
required  message  sets  for  each  exercise.  Additional  MWTB  assets 
included  a  classroom  for  initial  orientation  and  training,  and  an 
"extended"  classroom  in  the  simulation  bay  where  a  CCD 
demonstration  was  provided  via  a  large  screen,  57-inch  (144  cm) 
diagonal,  repeater  monitor  networked  to  a  stand-alone  CCD. 

Experimental  Design 

The  design  was  a  2  x  2  (low  and  high  information  amount  by 
low  and  high  information  relevance)  mixed  factorial  design  with 
repeated  measures  on  the  relevance  factor.  Participants  were  run 
in  groups  of  four  and  each  group  was  randomly  assigned  to  amount 
conditions  using  sampling  without  replacement.  After  completing 
each  of  the  four  test  information  management  exercises,  the 
participants  completed  situational  awareness  questionnaires  for 
their  current  and  future  battlefield  situation  and  provided 
ratings  on  situational  awareness  and  workload. 

Each  test  message  set  for  the  high  amount  condition  included 
21  different  CCD  reports.  Messages  sets  for  the  low  amount 
condition  included  only  9  messages,  subsets  extracted  from  each 
of  the  high  amount  message  sets.  Fixed-intervals  between 
messages  of  26  seconds  for  high  amount  participants  and  60 
seconds  for  the  low  amount  participants  ensured  reception  of  all 
messages  in  the  set  during  the  first  nine  minutes  of  each 
exercise.  For  the  high  relevance  condition,  100%  of  the  messages 
received  described  battlefield  conditions  within  the  platoon 
leader's  Alpha  company  sector.  For  low  relevance,  33%  of  the 
received  messages  described  Alpha  company  sector  conditions  and 
the  remaining  messages  described  conditions  in  adjacent  company 
sectors.  All  participants  completed  two  high  relevance  and  two 
low  relevance  message  sets. 

The  design  counterbalanced  information  relevance  by  message 
set  and  situational  awareness  forms  across  the  four  test  sessions 
completed  by  each  group.  Plotting  and  seeing  questionnaires  for 
each  session  alternated  between  the  current  and  future  situation 
to  reduce  an  item-response  set  for  this  after-the-exercise 
assessment.  The  Controller's  Log  in  Appendix  A  provides  the 
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counterbalanced  schedule  by  session  including  simulators  and  test 
materials  for  a  sample  group  of  participants.  The  message  sets 
used  for  the  test  information  management  exercises  are  provided 
in  Appendix  B.  Armor  SMEs  specified  item  content  for  all  message 
sets  and  situational  awareness  measures. 

Measures 

information  Acquisition  and  Communication.  The  CCD  includes 
an  instrumentation  package  that  automatically  records  the  time 
and  type  of  operator  inputs  for  many  of  the  CCD  functions.  The 
MWTB's  Data  Collection  and  Analysis  system  records,  maintains  and 
analyzes  the  data  packets  related  to  simulator  dynamics  and  CCD 
utilization.  For  this  evaluation,  additional  measures  that  more 
precisely  defined  the  platoon  leader's  information  acquisition 
and  communication  performance  were  developed  and  integrated  into 
standard  Data  Collection  and  Analysis  system  output  files.  The 
primary  information  acquisition  and  communication  measures  for 
this  effort  were:  message  content;  message  source;  tine  message 
received;  time  message  opened;  message  action  (e.g.,  relay, 
delete,  no  action;  time  message  action  taken;  direction  (net) 
message  relayed. 

Information  Requirements.  Participant  platoon  leaders  and 
company  commanders  completed  the  platoon  leader's  Information 
Requirements  questionnaire  in  their  simulators  at  the  end  of  the 
day.  The  questionnaire  required  each  participant  to  assign  relay 
ratings  to  the  21  messages  included  in  the  high  amount  message 
sets.  The  questionnaire  provided  a  synopsis  of  each  message  as 
presented  on  their  CCDs  to  ensure  ratings  were  assigned  to  the 
correct  message.  For  each  message,  respondents'  ratings 
indicated  if  the  message  should  be  Relayed  To  and  Relayed  By  a 
platoon  leader  on  a  4-point  scale  ranging  from  MDefinitely  Not 
Relay"  to  "Definitely  Relay." 

situational  Awareness.  The  situational  awareness  measures 
used  in  this  evaluation  (see  Appendix  C)  targeted  the  platoon 
leader's  awareness  of  his  current  and  future  battlefield 
situation  based  on  communications  received  during  each 
information  management  exercise.  The  current  situation  primarily 
included  items  related  to  the  front  of  his  current  battle 
position  and  the  future  situation  addressed  reported  information 
related  to  his  subsequent  battle  position  or  beyond  current 
range . 

Plotting  items  required  participants  to  designate  on  a 
military  map  the  locations  of  reported  enemy  units,  friendly 
units  and  key  control  measures.  Separate  five-item  sets  of 
plotting  questions  addressed  the  platoon  leader's  current  and 
future  situation  (see  Table  3).  Seeing  items  required  platoon 
leaders  to  compile  isolated  report  information  into  aggregate 
assessments,  to  estimate  the  size  of  designated  enemy  units 
including  main  und  attacking  units,  and  to  project  the  reported 
information's  impact  on  the  platoon's  current  and  future 
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Table  3 

Situational  Awareness  Items 


Current  Situation 

Future  Situation 

Plotting 

Largest  unit  engaged 

Largest  unit  approaching 
Friendly  scout  unit 

Target  reference  points 

Largest  unit  outside  sector 

Support  unit  to  rear 
Company's  subsequent  BP 
Obstacle (s)  to  rear 

Enemy  scouts  to  rear 

Mortar  unit  to  rear 

Seeing 

Number  4  type  enemy  damaged 
Size  4  type  unit  engaged 
Number  4  type  unit  approaching 
Size  4  type  force  approaching 
Overall  size  4  type  unit 
confronting  the  task  force 


Distance/direction  to  main  unit 
Heading  of  main  enemy  unit 
ETA  main  unit  <  2,000  meters 
Distance/direction  next  BP 
Impact  of  obstacle (a)  on  unit's 
next  BP 


Note.  ETA  ■  estimated  time  of  arrival;  BP  -  battle  position. 


situation.  Again,  five-item  sets  addressed  the  current  and 
future  situation  (see  Table  3). 

Each  participant's  awareness  of  the  situation  was  dependent 
on  the  information  provided  during  each  information  management 
exercise.  A  crosswalk  between  message  sets  differing  in 
information  amount  and  relevance  by  situational  awareness  items 
determined  the  correct  answers  for  each  information  management 
exercise.  Responses  were  scored  for  relative  accuracy  with  a 
maximum  of  10  points  per  item  (see  Appendix  D) .  Results  on  the 
situational  awareness  measures  are  reported  as  percentage  of 
points  obtained  on  plotting  and  seeing  questionnaire  formats. 

Ancillary  Measures.  Additional  measures  included  self- 
ratings  of  workload  and  situational  awareness.  Ratings  of 
situational  awareness  were  based  on  a  5-point  scale  anchored  from 
"No  Awareness"  to  "Complete  Awareness."  For  workload  assessment, 
selected  subscales  adapted  from  the  NASA-Task  Load  Index  (Hart 
and  Staveland,  1988)  addressed  perceived  mental  and  physical 
workload  for  each  information  management  exercise.  Workload  was 
measured  on  a  5-point  scale  anchored,  for  example,  from  "Very  Low 
Mental  Demand"  to  "Very  High  Mental  Demand." 
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A  final  measure  asked  participants  to  indicate  whether  voice- 
based  radio  or  the  CCD  would  provide  the  "Most  Assistance"  for  a 
selected  set  of  command;  control  and  communication  functions. 

The  functions  selected  were  not  intended  to  be  representative  of 
those  comprising  the  command;  control  and  communication  domain. 
Their  selection  was  based  on  informal  assumptions  about  some  of 
the  key  benefits  ascribed  to  each  modality.  In  addition,  this 
questionnaire  required  participants  to  rate  the  importance  of 
each  of  these  functions  on  a  5-point  scale  anchored  from  "Not 
Important"  to  "Extremely  Important."  Ancillary  measure  formats 
are  provided  in  Appendix  E. 

Procedure 

Procedures  for  the  participant  platoon  leaders  are  described 
below.  Procedures  for  the  raters,  SME  company  commanders,  were 
essentially  the  same.  The  primary  difference  was  that  company 
commanders'  training  and  evaluation  sessions  were  tailored  to 
their  duty  position,  Alpha  company  commander  (A06) .  When 
providing  relay  rating  data,  however,  the  company  commanders 
worked  as  surrogate  platoon  leaders  and  received  the  same 
messages  and  message  sets  used  for  the  participant  platoon 
leaders.  For  this  report,  only  the  rating  data  obtained  from 
these  company  commanders  on  the  platoon  leader's  Information 
Requirements  questionnaire  was  used. 

Training  and  data  collection  sessions  for  the  evaluation  were 
conducted  in  groups  of  four  and  required  one  day  per  group. 

During  the  AM  period,  participants  received  an  overview  brief  on 
the  evaluation,  a  group-level  demonstration  of  the  CCD,  and  two 
practice  sessions  conducted  in  their  simulators.  Training  and 
evaluation  sessions  employed  the  same  structure  beginning  with  an 
information  management  exercise  in  which  each  participant 
received,  processed  and  relayed  the  designated  message  set 
followed  by  completion  of  the  situational  awareness  and  workload 
measures.  Each  session  required  approximately  30  minutes.  The 
PM  period  commenced  with  a  final  practice  session  followed  by 
four  test  sessions.  After  a  classroom  debrief  and  questionnaire 
session,  participants  returned  to  their  simulators  and  provided 
relay  ratings  on  two  of  the  four  high  amount  message  sets  used  in 
the  evaluation.  The  training  and  testing  schedule  is  provided  in 
Appendix  F. 

Instructions  to  the  participants  in  the  overview  brief  and 
during  training  sessions  addressed  information  management  issues 
with  the  CCD.  Instructions  stressed  that  participants  should 
base  their  relay  decisions  on  the  trade-offs  associated  with 
information  overload  and  the  receiver's  need-to-know.  Training 
session  and  classroom  instructions  described  the  CCD's  default 
routing  mechanism  for  relaying  messages.  The  default  parameters 
were  that  Intelligence  reports  automatically  selected  the 
downward  net  (i.e.,  platoon  net)  and  Spot  and  Contact  reports, 
the  upward  net  (i.e.,  company  net).  Training  stressed  manual 
override  of  the  default  net  selection  when  required  and  cautioned 


that  over-reliance  on  the  default  mechanism  might  result  in 
relays  on  the  wrong  net. 

The  operational  setting  for  all  exercises  designated  each 
participant  as  the  platoon  leader  of  the  second  platoon  of  Alpha 
company  (A21) .  Alpha  company  always  occupied  a  central  sector 
within  the  task  force  and  its  second  platoon  was  assigned  the 
central  battle  position,  current  and  subsequent,  within  tne 
company's  sector.  As  part  of  their  assigned  role,  participants 
were  expected  to  maintain  their  awareness  of  the  battlefield 
situation  based  on  incoming  reports  and  be  prepared  to  direct 
their  unit  to  a  subsequent  battle  position  as  the  situation 
required.  At  the  same  time,  they  were  to  maintain  the  awareness 
of  their  superiors  and  subordinates  by  forwarding,  or  relaying, 
as  many  of  the  reports  as  warranted. 

Five  minutes  prior  to  the  start  of  each  session,  participants 
were  provided  a  1:50,000  scale  military  map  sheet,  map  board,  and 
acetate  operational  and  note  overlays  for  their  current  location 
and  operational  situation.  An  extract  of  an  operations  order, 
see  Appendix  G,  was  also  provided  to  aid  participants  in  their 
transition  through  the  series  of  practice  and  test  exercises 
varying  battlefield  locations  and  situations.  At  the  start  of 
each  session,  all  CCDs  were  configured  at  1:50,000  scale  and 
centered  at  the  location  of  each  platoon  leader's  unit. 

When  all  participants  in  the  group  responded  "REDCON  1"  to 
the  controller  indicating  ready,  the  information  management 
exercise  began  with  the  controller's  activation  of  a  SEND- 
executable  file  that  initiated  message  set  transmission.  During 
the  exercise,  participants  received  the  designated  messages  on 
their  CCD  and  were  expected  to  process  each  message  as 
appropriate  to  their  duty  position  including  relays  to  superiors 
and  subordinates.  They  were  allowed  to  make  any  notes  on  their 
acetate  note  overlay  concerning  the  information  received. 

Immediately  after  completion  of  the  information  management 
exercise  portion  of  the  session,  participants  were  escorted  out 
of  the  simulators  to  separate  work  areas  for  completion  of  the 
situational  awareness  and  workload  measures.  Upon  leaving  the 
simulator,  each  platoon  leader  returned  to  the  support  personnel 
the  map  board,  overlays  and  any  notes  he  might  have  made  during 
the  exercise  concerning  the  information  received.  Participants 
recorded  responees  for  the  seeing  measure  on  their  questionnaire 
and  plotted  locations  on  a  black-and-white  xerox  copy  of  the 
colored  map  sheet  lor  the  plotting  measure.  Upon  completion  of 
the  questionnaires,  each  participant  "backbrlefed"  to  support 
personnel  his  situational  awareness  and  workload  responses  to 
vsrify  all  answers  wore  interpreted  correctly. 

After  completion  of  the  final  Information  management  exercise 
and  situational  awaroness  questionnaires,  each  group  of 
participants  returned  to  the  classroom  for  a  final  dsbrlef. 

During  this  session  each  participant  completed  the  ancillary 
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measure  on  the  relative  importance  of  selected  command,  control 
and  communication  functions  and  their  assessment  of  whether  the 
voice-based  radio  or  CCD  the  would  provide  the  most  assistance  in 
performing  each  function. 

Participants  were  then  instructed  on  completion  of  a  final 
questionnaire  intended  to  determine  platoon  leader  information 
requirements.  After  this  quest ionna ire 's  format  and  response 
alternatives  were  reviewed,  participants  returned  to  their 
simulators  where  they  received  two  of  the  high  amount  message 
sets  on  their  CCDs.  For  each  message,  participants  rated  whether 
it  should  or  should  not  be  relayed  "to"  and  ••by"  a  typical 
platoon  leader  in  this  situation.  During  this  rating  session,  no 
time  constraints  were  imposed  and  participants  were  not  required 
to  relay  the  messages  or  prepare  for  a  subsequent  situational 
awareness  assessment. 

Analysis.  All  analyses  were  performed  using  SPSS/PC+ 
routines  (Norusis,  1988).  Primary  analyses  used  the  multivariate 
analysis  of  variance  (MANOVA)  program  for  repeated  measures.  All 
interactions  were  tested  using  MANOVA  simple  effects  tests  that 
maintained  the  overall  mixed-model  and  used  separate  error  terms 
at  each  level  of  the  variable  tested.  Additional  analysis 
procedures  are  indicated  as  results  are  reported. 

For  comparability,  analyses  on  message  processing  accuracy, 
speed  and  type  of  action  taken  were  based  on  the  36  identical 
messages  (9  messages  per  set  x  4  test  exercises)  commonly 
received  by  participants  in  the  low  and  high  amount  conditions. 
Common  messages  within  each  set  were  received  in  the  same  order 
by  all  participants  with  additional  messages  interspersed  for  the 
high  amount  condition  (Appendix  B) .  Results  on  the  additional 
messages  received  by  the  high  amount  condition  are  not  reported 
but  were  similar  to  those  for  the  common  set. 

Unless  otherwise  indicated,  repeated  measures  within  a  level 
of  relevance  were  collapsed.  The  primary  distinctions  between 
equivalent  relevance  sots  were  battlefield  location  and  threat 
type.  Differences  on  these  factors  were  neither  expected  nor 
detected.  The  locations  were  successive  battle  positions  within 
a  company-level  defensive  scenario  (Leibrecht  et  al.,  1992)  and 
provided  very  similar  terrain  and  boundary  features.  Tank  versus 
mechanized  rifle  regiment  threat  types  were  based  on  Soviet  force 
structures  and  comprised  a  mix  of  tank  and  personnel  vehicles 
rather  than  "pure"  threat  types. 

Rasul ts 

This  section  begins  by  considering  evidence  obtained  that 
assignment  of  participants  to  the  high  and  low  amount  conditions 
resulted  in  equivalent  groups  and  that  the  platoon  leader 
participants  correctly  understood  the  information  management 
requirements  for  their  duty  position.  Uubetantive  findings 
related  to  the  effects  of  msssags  numbar  and  rslsvanos  on 
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participants'  information  management  performance  are  then 
reported,  followed  by  findings  based  on  ancillary  measures. 
Finally,  data  obtained  to  check  the  method  used  for  delivering 
and  standardizing  information  management  exercises  used  in  this 
evaluation  are  presented. 

Group  Equivalence 

Results  indicated  that  the  low  and  high  amount  conditions 
were  equivalent  with  respect  to  age,  military  service,  time  in 
armor  and  the  platoon  leader  duty  position,  and  prior  computer 
experience.  Results  from  a  series  of  analysis  of  variance 
(ANOVA)  tests  on  these  biographical  items  with  amount  as  the 
between-subjects  factor  are  presented  in  Table  4.  Random 
assignment  appeared  to  successfully  equate  the  low  and  high 
amount  groups.  Subsequent  differences  on  dependent  measures 
should  not  be  the  result  of  prior  differences  on  any  of  these 
measures. 

Understanding  of  Platoon  Leader  Information  Requirements 

In  preface,  the  results  indicated  the  sample  of  platoon 
leaders  correctly  understood  the  information  requirements  for 
their  duty  position.  This  was  a  key  concern  due  to  the  limited 
experience  of  the  primary  participants  as  platoon  leaders. 

Recall,  the  Information  Requirements  questionnaire  was  developed 
to  assess  the  participants'  knowledge  of  what  information  a 
platoon  leader  needed  to  acquire  (Relay  To)  and  communicate 
(Relay  By)  based  on  all  messages  developed  for  the  information 
management  exercises. 

The  mean  relay  ratings  by  platoon  leaders  and  SHE  company 
commanders  are  provided  in  Table  5.  These  ratings  include  the 
Relay  To  and  Relay  By  categories  and  are  based  on  all  messages 
developed  for  the  four  high  amount  message  sets.  Measures  of 
interrater  agreement  provided  in  Table  6  indicate  that  the 
platoon  leader  ratings  concurred  with  those  provided  by 
the  company  commanders.  The  Cronbach  estimates  were  based  on  the 
Alpha  Model  (Norusis,  1968)  using  platoon  leader  versus  company 
commander  mean  ratings  for  each  message.  The  Alpha  values  ranged 
from  .44  to  .94  suggesting  substantial  agreement  between  platoon 
leaders  and  company  commanders. 

These  estimates  were  limited  by  positively  skewed  rating 
distributions  for  the  low  relevance  message  sets  and  negatively 
skewed  distributions  for  the  hiah  relevance  sets.  Whitehurst 
(1904)  urged  the  use  of  Finn's  index  to  overcome  limitations 
associated  with  traditional  measures  of  interratar  agreement 
affected  by  response  distributions.  Finn's  index  is  based  on 
observed  wlthin-subjeota  variance  adjusted  by  expected  within- 
subjeots  variance  for  ratings  randomly  assigned  and  is  less 
affected  by  rating  distributions  (Whitahurst,  1984). 


Table  4 

Source  Table  on  Group  Equivalence  by  Information  Amount 


Source 

df 

Mean 

Square 

£ 

C 

Age 

Amount 

1,14 

4.0 

.29 

.60 

Service  Experience 

Amount 

1,14 

0.3 

.00 

.99 

Armor  Experience 

Amount 

1,14 

306.3 

.75 

.40 

Platoon  Leader  Experience 
Amount 

1,14 

42.3 

1.22 

.29 

Computer  Experience 

Amount 

1,14 

0.1 

.11 

.74 

The  Table  6  values  obtained  for  Finn's  index  ranged  from  .89 
to  .97  demonstrating  substantial  interrater  agreement  botween  the 
ratings  provided  by  the  platoon  leader  sample  and  the  more 
experienced  company  commanders.  Finally/  computed  probabilities 
for  Kendall's  coefficient  of  concordance  Indicated  significant 
agreement  between  platoon  leader  and  company  commander  ratings 
for  each  of  the  message  sets  developed  (all  ps  <  .03). 

MfiBiaqt  EEflfiialna  Accuracy 

Accuracy  data  are  reported  from  three  sources.  First, 
comparisons  between  participant  platoon  leader  relay  performance 
and  company  commander  relay  ratings  are  presented.  Next, 
comparisons  between  participant  relay  performance  and  their  own 
relay  ratings  are  presented.  Finally,  participant  selection  of 
combat  radio  net  for  message  relay  is  considered. 

Based  on  Company  Commander  Relay  Ratings.  In  preface, 
information  amount  had  no  overall  effect  on  relay  eoouracy, 
contrary  to  prediction.  However,  information  amount  did  affect 
the  type  of  relay  errors  made.  Participants  receiving  fewer 
messages  relayed  significantly  more  Information  and  participants 
receiving  more  messages  relayed  significantly  less.  As 
predicted,  messages  from  the  high  relevance  message  sets  were 
relayed  more  accurately.  The  primary  source  of  error,  with 
respect  to  relevance,  was  the  relay  of  too  many  messages  from  low 
relevanoe  message  sets. 

Recall,  that  participants'  concurrence  with  the  company 
commanders'  relay  ratings  indicated  they  correctly  understood 
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Table  5 


Mean  Relay  Ratings  (and  SDs)  by  Platoon  Lsadars  (PLs)  and  Company 
Commanders  (CCs)  on  Relay  To  and  Relay  By  Categories 


Ratings  LRi  LRj  HR:  HRa 


Relay  To 


PLs 

3.20 

(.27) 

2.96 

(.37) 

3.59 

(.12) 

3.79 

(.20) 

CCS 

3.17 

(.46) 

2.67 

(.51) 

3.36 

(.27) 

3.67 

(.20) 

ReLay  By 

PLs 

2.82 

(.38) 

2.51 

(.44) 

3.32 

(.26) 

3.46 

(.12) 

CCs 

2.61 

(.50) 

2.45 

(.28) 

2.92 

(.25) 

3.49 

(-10) 

Note.  LR  -  Low  Relevanco,  HR  -  High  Relevance.  PL's  u  -  16,  n  ■ 
8  per  message  set.  CC's  H  ■  12,  n  -  6  per  message  set. 


Table  6 

Interrater  Agreement  of  Platoon  Leaders  and  Company  Commanders 
on  Platoon  Leader  Information  Requirements  by  Message  set 


Ratings 


Cronbach's  Finn's  Kendall's  Concordance 
Alpha  Index  Hx.fi 


Relay  To 


Low  Relevance} 

.84 

.92 

.48 

105.6 

.00 

Low  Relevance] 

.85 

.86 

.51 

161.7 

.00 

High  Relevance} 

.94 

.97 

.34 

103.4 

.00 

High  Relevanoea 

.44 

.96 

.11 

34.1 

.03 

Relay  By 

Low  Relevance} 

.85 

.89 

.45 

135.0 

.00 

Low  Relevance2 

.94 

.91 

.56 

178.1 

.00 

High  Relevance} 

.90 

.93 

.37 

110.8 

.00 

High  Relevance] 

.68 

.94 

.16 

48.4 

.00 

Hots.  For  platoon  leaders,  H  ■  16  And  q  >  8  per  message  set. 
For  company  commanders,  H  ■  12  and  n  •  6  per  message  set. 
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their  information  requirement*  in  a  nonoperational  setting.  In 
contrast,  the  information  management  exercises  were  designed  to 
assess  their  performance  in  a  simulated  operational  setting. 

While  limited,  conditions  for  this  setting  included  the  simulated 
"pace  of  operations"  generated  by  information  amount,  external 
time  constraints  and  the  requirement  to  maintain  awareness  of  the 
emerging  battlefield  situation. 

To  assess  relay  accuracy  on  each  of  the  nine  common  messages 
in  each  message  set,  participant's  relay  performance  during  the 
simulated  information  management  exercises  was  compared  with  the 
company  commanders'  mean  Relay  By  rating  for  each  message.  An 
accurate  relay  was  defined  as  equivalent  relay  performance  and 
rating,  based  on  dichotomous  categorization  of  the  rating  data. 
For  inaccurate  relays,  over  relay  was  defined  as  participant's 
relay  of  a  message  that  company  commanders  rated  "Definitely  Not 
Relay"  or  "Not  Relay."  Under  relay  was  the  failure  to  relay  a 
message  company  commanders  rated  "Definitely  Relay”  or  "Relay.” 

Mean  percentages  and  standard  deviations  on  inaccurate 
relays  by  information  amount  and  relevance  are  provided  in 
Appendix  H,  based  on  company  commander  ratings.  Types  of  error 
reported  are  over  and  under  relays.  Corresponding  percentages 
are  provided  in  Figure  2.  Results  from  a  repeated  measures 
MANOVA  on  number  of  inaccurate  relays  are  provided  in  Table  7. 

overall,  participants  accurately  relayed  77.7%  of  tho  common 
set  messages  received  during  the  information  management 
exercises,  based  on  company  commander  ratings.  Although 
information  amount  had  no  overall  effect  on  relay  accuracy,  the 
Amount  x  Type  of  relay  error  interaction  was  significant  (Table 
7) .  Simple  effects  test  revealed  that  low  amount  participants 
relayed  more  of  the  messages  that  company  commanders  had  rated  as 
not  appropriate  for  relay  (£  1,14  -  28.12,  p  -  .000)  and  high 
amount  participants  relayed  significantly  fewer  of  the  massages 
rated  as  appropriate  for  relay  (£  1,14  ■  13.85,  p  -  .002). 

Overall,  participants  accurately  relayed  67.4%  of  the 
messages  from  low  relevance  sets  and  88.0%  of  the  messages  from 
high  relevance  sets,  bassd  on  company  commander  ratings.  As 
predicted,  messages  from  the  high  relevance  massage  sets  were 
relayed  more  accurately  (Table  7).  A  simple  effects  test 
revealed  significantly  more  over  relays  on  the  low  relevance 
message  sets  (£  1,14  ■  28.01,  p  -  .000). 

Based  on  Own  Relay  Ratines.  Comparisons  with  platoon 
leaders'  own  relay  ratings  were  conducted  to  provide  additional 
information  on  relay  errors.  In  preface,  results  on  information 
amount  were  similar  to  those  based  on  company  commander  ratings 
but  information  relevance  had  no  effect.  As  with  company 
commander  ratings,  participants  receiving  fewer  messages  relayed 
too  much  information  while  participants  receiving  more  messages 
did  not  relay  enough. 
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INFORMATION  «■  LAV  AN  Cl 


Figure  2.  Message  processing  accuracy:  Mean  percentage  of  relay 
errors  based  on  company  commander  relay  ratings. 

The  tabulation  of  relay  errors  was  identical  to  that  used 
with  company  commander  ratings  except  that  each  participant's 
relay  performance  was  compared  with  his  own  relay  rating  on  each 
message.  Mean  percentages  and  standard  deviations  on  inaccurate 
relays  by  information  amount  and  relevance  are  provided  in 
Appendix  H,  based  on  platoon  leader  ratings.  Results  from  a 
repeated  measures  MANOVA  on  number  of  messages  inaccurately 
relayed  are  provided  in  Table  7. 

Overall,  participants  accurately  relayed  73.9%  of  the  common 
set  messages  received  during  the  information  management 
exercises,  based  on  participant  ratings.  Although  information 
amount  and  relay  error  type  were  significant,  interpretation  is 
dependent  on  the  significant  Amount  x  Type  interaction  (Table  7). 
A  simple  effects  test  revealed  that  low  amount  participants 
relayed  more  of  the  messages  that  company  commanders  had  rated  as 
not  appropriate  for  relay  (£  1,14  «  38.33,  p  -  .000).  Similarly, 
high  amount  participants  relayed  significantly  fewer  of  the 
messages  rated  as  appropriate  for  relay  (£  1,14  ■  26.53,  p  « 

.000) . 


Baaed  on  Eslay_flet  Selections.  A  related  measure  of  message 
processing  accuracy  was  correct  net  selection  for  each  message 
relayed.  Recall,  that  if  the  CCD's  default  selection  was 
incorrect,  participants  could  simply  override  the  default  by 
selection  of  the  correct  net.  On  messages  relayed,  participants 
accepted  all  correct  default  net  selections  and  251  of  all 
incorrect  default  net  selections.  There  were  no  significant 
differences  in  net  selection  by  information  amount  and  only  low 
relevance  message  sets  included  incorrect  default  selections. 
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Table  7 


Source  Table  on  Inaccuracies  in  Message  Processing  by  Information 
Amount,  Relevance,  and  Type  of  Error  (Over  and  Under  Relay) 


Source 

df 

Mean 

Square 

Z 

£ 

Platoon  Leader  Relays 

Versus  Company  Commander  Relay  Ratings 

PL  vs  CC 

Amount 

1,14 

0.1 

.08 

.78 

Relevance 

1,14 

13.8 

12.81 

.003** 

Type 

1  ,  14 

4.5 

2.19 

.16 

Amount  by  Relevance 

1,14 

3.8 

3.58 

.08 

Amount  by  Type 

1,14 

11.4 

5.53 

.03* 

Relevance  by  Type 

1,14 

21.4 

34.85 

.000*“ 

Amount  by  Relevance 

1,14 

0.8 

1.25 

.28 

by  Type 

Platoon  Leader  Relays  Versus 

Own  Relay  Ratings 

PL  vs  Own 

Amount 

1,14 

27.6 

4.60 

.05 

Relevance 

1,14 

7.6 

1.81 

.20 

Type 

1,14 

45.6 

8.75 

.01“ 

Amount  by  Relevance 

1,14 

5.1 

1.21 

.29 

Amount  by  Type 

1,14 

52.6 

10.10 

.007“ 

Relevance  by  Type 

1,14 

0.6 

0.13 

.72 

Amount  by  Relevance 

1,14 

0.1 

0.01 

.90 

by  Type 

* B< .05. 


Mwaqe  Procffllnq  fipsad 

In  preface,  the  time  to  open  messages  received  was  not 
significantly  affected  by  information  amount  or  relevanoe, 
contrary  to  expectations.  High  amount  participants,  however, 
opened  messages  five  seconds  slower,  on  the  average.  The  read 
time  for  high  amount  participants  was  significantly  shorter  than 
that  of  low  amount  participants.  As  predicted,  read  time  for  the 
high  relevance  message  sets  was  significantly  faster.  Contrary 
to  expectation,  relay  time  was  not  significantly  affected  by 
information  amount.  As  predicted,  messages  from  high  relevance 
exercises  were  relayed  faster. 

The  primary  message  processing  speed  measures  were  the  time 
to  open,  read  and  relay  the  messages  received  during  the 
information  management  exercises.  Means  and  standard  deviations 
on  each  of  these  measures  for  messages  processed  while  in  the  CCD 
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Receive  Queue  are  provided  in  Appendix  H.  Corresponding  mean 
times  are  provided  in  Figure  3.  Results  from  repeated  measures 
MANOVAs  on  time  to  open,  read  and  relay  messages  in  the  Receive 
Queue  are  provided  in  Table  8. 

Messages  not  acted  on  while  in  the  Receive  Queue  could  be 
processed  under  a  CCD  feature  called  Old  Files.  Limited  activity 
in  the  Old  Files  precluded  processing  speed  comparisons.  Results 
for  Old  Files  are  provided  in  a  following  section  titled  Message 
Processing  Actions. 

Opening  Time.  Message  opening  time  was  defined  as  elapsed 
time  from  CCD  message  reception  to  participant's  activation  of 
the  SHOW  Key  which  displayed  that  message's  textual  content.  For 
messages  relayed  from  the  Receive  Queue,  average  opening  time  was 
8.2  seconds  for  the  low  amount  condition  and  13.2  seconds  for 
high  amount.  As  indicated  in  Table  8,  these  opening  times  were 
not  significantly  different  by  information  amount.  Multivariate 
homogeneity  of  variance  tests  on  opening  times  revealed 
significantly  greater  variability  by  high  amount  participants. 
Box's  M  ■  29.2,  x2  (3,  U  -  16)  -  24.7,  b  ■  .00.  Opening  time  by 
message  set  relevance  indicated  participants  tended  to  open 
messages  from  the  high  relevance  messages  sets  more  quickly  but 
this  difference  was  not  significant  (p  -  .07). 

Read  Time.  For  relayed  messages,  time  to  "read"  was  based  on 
elapsed  time  from  message  opening  to  activation  of  the  PREP  key 
which  prepared  that  message  for  relay.  Read  time  included  the 
time  to  comprehend  the  message,  to  determine  appropriate  message 
action  (relay,  delete,  take  no  action)  and  any  time  participant 
might  have  elected  to  take  notes  on  the  message's  content.  For 
messages  relayed  from  the  Receive  Queue,  the  overall  average  read 
time  was  24.0  seconds  for  the  low  amount  condition  and  17.3 
seconds  for  high  amount  participants.  As  anticipated,  read  times 
for  the  high  amount  condition  and  high  relevance  message  sets 
were  significantly  faster  (Table  8) . 

Relay  Time.  Relay  time  was  based  on  time  from  message 
recaption  by  the  CCD  to  activation  of  the  SEND  key  by  the 
participant.  Relay  time  included  opening  time,  read  time  and  any 
additional  time  spent  on  net  selection  and  message  posting  to  the 
CCD's  map  display.  For  messages  relayed  from  the  Receive  Queue, 
average  relay  time  was  32.1  seconds  for  the  low  amount  condition 
and  30.4  seconds  for  high  amount.  Contrary  to  expectation,  relay 
times  were  not  significantly  different  between  groups  (Table  8) 
but  the  relay  times  for  high  amount  participants  were  more 
variable.  Bartlett-Box  homogeneity  tests  on  relay  times  for  low 
relevance  (£  1,588  ■  5.68,  p  -.02)  and  high  relevance  (£  1,588  - 
4.21,  p  -.04)  message  sets  were  significant  and  the  multivariate 
tost  approached  significance,  Box's  M  -  8.6,  x2  (3,  U  -  16)  - 
7.3,  a  "  *06.  As  expected,  the  high  relevance  message  sets  had 
significantly  faster  relays  than  low  relevance  message  sets. 
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Figure  3.  Message  processing  speed  for  receive  queue  relays  by 
information  amount  and  relevance. 

Delete  Time.  For  messages  deleted  from  the  Receive  Queue , 
opening  times  and  relay  times  were  similar  to  those  for  messages 
relayed.  However,  the  overall  average  read  time  for  messages 
deleted  was  16.2  seconds  compared  to  20.7  seconds  for  messages 
relayed.  As  the  low  amount  condition  deleted  no  messages  from 
the  high  relevance  message  sets,  a  repeated  measures  MANOVA  was 
performed  on  only  the  high  amount  condition.  Although  not 
predicted,  this  analysis  indicated  that  messages  in  the  Receive 
Queue  were  deleted  significantly  faster  than  they  were  relayed 
(E  1,6  -  9.22,  fi  -  .02) . 


In  preface,  low  amount  participants  relayed  more  messages  and 
deleted  fewer  messages,  as  predicted.  Contrary  to  expectation, 
no  difference  was  found  for  number  of  messages  acted  on  between 
the  two  amount  conditions.  As  predicted,  messages  from  the  high 
rolevance  message  sets  were  more  frequently  relayed  and  acted  on 
and  less  frequently  deleted. 

Receive  Queue  Actions.  Message  processing  actions  analyzed 
were  message  relay,  message  deletion,  no  action,  and  failure  to 
open  a  message  received.  Only  opened  messages  could  be  relayed 
and  a  message  in  the  Receive  Queue  could  not  be  both  relayed  and 
deleted.  If  a  message  was  neither  relayed  nor  deleted,  message 
processing  was  classified  as  no  action.  Messages  riot  opened,  no 
activation  of  the  SHOW  Key,  were  classified  as  such.  It  should 
be  noted  that  failure  to  open  a  message  is  not  necessarily  an 
incorrect  response.  A  message's  icon  is  automatically  depicted 
on  the  CCD's  tactical  map  at  time  of  reception,  prior  to  opening. 
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Table  8 


Source  Table  on  Speed  of  Message  Processing  by  Information  Amount 
and  Relevance 


Source 

df 

Mean 

Square 

£ 

B 

Opening  Time 

Amount 

1/14 

224.7 

2.40 

.14 

Relevance 

1,14 

35.5 

3.84 

.07 

Amount  by 

Relevance 

1/14 

13.8 

1.49 

.24 

Read  Time 

Amount 

1/14 

353.8 

8.32 

.01" 

Relevance 

1/14 

12.5 

4.63 

.05* 

Amount  by 

Relevance 

1/14 

0.1 

.04 

.85 

Relay  Time 

Amount 

1/14 

14.6 

.09 

.77 

Relevance 

1/14 

90.1 

10.40 

.01" 

Amount  by 

Relevance 

1/14 

11.5 

1.33 

.27 

*p< .  05  •  **p< .  01 . 


The  information  it  provides  on  unit  type,  alignment  (friendly  or 
threat)  and  proximity  may  suffice. 

Mean  percentage  data  for  each  of  the  four  types  of  message 
actions  by  information  amount  and  relevance  are  provided  in 
Appendix  H.  Corresponding  percentages  for  messages  relayed, 
deleted  and  not  acted  on  are  presented  in  Figure  4 .  Due  to 
patterns  of  nonnormality  and  heterogeneity,  a  series  of 
nonparametric  analyses  were  conducted  on  mean  number  of  message 
actions  for  each  action  type. 

Overall,  more  than  three-fourths  of  all  such  messages 
received  were  relayed  and  14.2%  were  deleted.  A  small,  but 
substantial,  portion  (8.3%)  were  not  acted  on  while  in  tha 
Receive  Queue.  A  series  of  Mann-Whitney  U  tests  indicated 
significant  differences,  as  anticipated,  between  the  low  and  high 
amount  conditions  on  number  of  messages  relayed  (U  ■  8.0,  p  * 

.01)  and  number  of  messages  deleted  (U  -  2.0,  p  -  .00)  with  two- 
tailed  probabilities  corrected  for  ties. 

These  comparisons  indicated  the  low  amount  condition  relayed 
more  messages  and  deleted  fewer  relative  to  high  amount 
participants.  No  difference  was  found  for  number  of  messages  not 
acted  on  between  the  two  amount  conditions.  Overall,  all  but 
three  of  the  common  set  messages  received  were  opened.  Only 
participants  in  the  low  amount  condition  left  messages  in  the 
Receive  Queue  unopened,  a  nonsignificant  difference  (p  -  .06). 
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Figure  4.  Message  processing  actions  in  the  receive  queue  by 
information  amount  and  relevance. 

The  effect  of  information  relevance  on  mean  number  of  message 
actions  taken  was  assessed  with  a  series  of  Wilcoxon  Matched- 
pairs  Signed-ranks  tests  on  low  and  high  relevance  message  sets. 
As  expected,  relevance  differences  were  found  for  number  of 
messages  relayed  (£  -  -3.516,  two-tailed  p  -  .011),  number  of 
messages  deleted  (£  -  -3.139,  two-tailed  p  »  .002)  and  number  of 
messages  not  acted  on  (£  «  -2.251,  two-tailed  p  *  .024).  These 
results  confirmed  that  messages  in  the  high  relevance  sets  were 
relayed  more  frequently  and  deleted  less  often,  and  that  messages 
in  the  low  relevance  sets  were  more  likely  to  receive  no  action. 

Old  Files  Actions.  As  noted,  nearly  all  message  activity 
occurred  while  the  messages  were  in  the  Receive  Queue.  The  CCD's 
Old  Files  were  designed  for  more  extended  operational  settings 
but  during  the  information  management  exercises  the  Old  Files 
stored  a  copy  of  each  message  received  that  was  not  explicitly 
deleted  by  the  participants.  Presumably,  the  10-minute  duration 
of  the  information  management  exercises  restricted  the  need  or 
ability  of  participants  to  review  messages  stored  in  Old  Files. 
Notably,  no  high  amount  participant  used  the  Old  Files.  Five  of 
the  eight  low  amount  participants  accessed  messages  stored  in  Old 
Files,  but  only  10  of  the  Old  File  messages  were  relayed  or 
deleted.  As  7  of  these  10  actions  were  message  deletions.  Old 
File  activity  primarily  appeared  to  be  of  a  "housekeeping" 
nature. 


In  preface,  low  amount  participants  more  accurately  plotted 
locations  on  the  information  received  during  the  information 
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management  exercises,  as  predicted.  Contrary  to  expectation,  low 
amount  participants  were  not  better  at  seeing  the  battlefield 
situation  reported.  As  predicted,  participants  were  better  at 
seeing  the  battlefield  situation  conveyed  by  high  relevance 
message  sets,  contrary  to  expectation,  plotting  performance  was 
not  affected  by  information  relevance. 

Recall,  that  separate  questionnaires  for  measuring  plotting 
and  seeing  performance  were  developed  to  assess  participants' 
awareness  of  the  battlefield  situation  depicted  by  each  message 
set.  Alternate  forms  of  each  questionnaire  type  were  designed  to 
measure  participants'  awareness  of  the  current  and  future 
battlefield  situation. 

Mean  percentages  and  standard  deviations  obtained  on  plotting 
and  seeing  performance  are  provided  by  information  amount  and 
relevance  in  Appendix  H.  Corresponding  percentages  are  presented 
in  Figure  5.  As  performance  on  the  plotting  and  seeing  measures 
was  not  correlated,  a  multivariate  analyses  combining  plotting 
and  seeing  performance  was  not  conducted.  Repeated  measures 
MANOVAs  for  plotting  and  seeing  percentage  data  by  information 
amount,  relevance  and  situation  were  conducted  and  are  summarized 
in  Table  9. 

Across  all  platoon  leader  participants,  the  mean  percentages 
for  plotting  and  seeing  were  46.2%  and  69.5%,  respectively.  When 
performance  on  the  plotting  and  seeing  measures  were  combined, 
mean  percentages  on  situational  awareness  were  60.2%  for  the  low 
amount  condition  versus  55.4%  for  the  high  amount.  For  the 
plotting  data,  overall  percentages  for  the  low  versus  high  amount 
conditions  were  52.0%  and  40.3%,  respectively. 

As  expected,  the  low  amount  condition  performed  significantly 
better  in  plotting  the  battlefield  situation  depicted  by  the 
information  management  exercises  (Table  9) .  Contrary  to 
expectation,  information  relevance  had  no  effect  on  plotting 
performance.  Overall  percentage  data  for  plotting  the  current 
battlefield  situation  was  41.8%  compared  to  50.5%  for  the  future 
situation,  a  difference  only  approaching  significance.  None  of 
the  two-way  interactions  for  plotting  were  significant,  but  the 
three-way  interaction  of  Amount  by  Relevance  by  Situation  was 
significant.  A  simple  effects  test  indicated  that  when  plotting 
the  future  situation,  low  amount  participants  were  more  accurate 
on  low  relevance  exercises  while  high  amount  participants  were 
more  accurate  on  high  relevance  exercises  (£  1,14  =  5.99,  p  = 
.03).  This  interaction  was  neither  anticipated  nor  understood. 

For  the  seeing  data,  overall  percentages  for  the  low  versus 
high  amount  conditions  were  68.4%  and  70.5%,  respectively. 
Contrary  to  hypothesized  expectancies,  this  difference  was  not 
significant.  Participants  averaged  74.5%  on  the  high  relevance 
message  sets  compared  to  64.4%  on  the  low  relevance  sets  for 
seeing  data.  As  predicted,  participants  ability  to  see  the 
battlefield  situation  was  significantly  better  on  the  high 
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Figure  5.  Situational  awareness  percentages  for  plotting  and 
seeing  by  information  amount  and  relevance. 

relevance  message  sets  (Table  9).  Participants'  seeing 
performance  averaged  65.7%  on  the  current  battlefield  situation 
compared  to  73.3%  for  the  future  situation,  a  nonsignificant 
difference.  None  of  the  interactions  on  seeing  performance  were 
significant. 

Ancillary  Measures 

In  preface,  significant  differences  were  not  obtained  on 
participants'  subjective  assessment  of  situational  awareness  or 
workload  during  the  evaluation,  contrary  to  prediction.  As 
predicted,  ratings  on  the  assistance  provided  by  the  CCD  versus 
voice-based  radio  were  highly  discriminant  and  indicated  the 
complementary  need  for  both  systems  to  support  command,  control 
and  communication  functions. 

In  general,  participants  rated  their  awareness  of  the 
battlefield  situations  depicted  by  the  information  management 
exercises  near  the  '‘High  Awareness”  anchor  with  an  overall  mean 
rating  of  3.81,  standard  deviation  =  .57.  Mean  situational 
awareness  ratings  for  low  versus  high  amount  conditions  were  in 
the  expected  direction,  3.97  and  3.66  respectively.  Across  all 
message  sets,  mean  rating  for  mental  workload  was  3.09  and  for 
physical  workload,  1.61.  This  difference  was  significant  based 
on  the  Wilcoxon  Matched- pairs  Signed-ranks  Test  (£  =  -3.4078, 
2-tailed  p  <  . 001) . 

Overall  mean  ratings  on  the  importance  of  selected  command, 
control  and  communication  functions  are  provided  in  Table  10  by 
rank  order.  Mean  ratings  ranged  from  4.88  (5.0  «  "Extremely 
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Table  9 

Source  Table  on  situational  Awareness  Kaaauraa  by  information 
Amount,  Relevance,  and  Situation 


Source 

df 

- Heim - 

Square 

z 

£ 

Plotting 

2209.0 

4.74 

Amount 

1,14 

.047* 

Relevance 

1,14 

4.0 

.01 

.910 

Situation 

1,14 

1190.2 

3.99 

.097 

Amount  by  Relevance 

1,14 

200.9 

.93 

.301 

Amount  by  Situation 

1,14 

390.1 

1.30 

.274 

Relevance  by  Situation 

1,14 

139.1 

.91 

,422 

Amount  by  Relevance 
by  situation 

1,14 

1109.0 

9.72 

.031’ 

Seeing 

Amount 

1,14 

99.1 

.40 

.013 

Rslevenoe 

1,14 

1920.1 

19.00 

.001“* 

sit  uetion 

1,14 

910.1 

2.27 

.104 

Amount  by  Relevance 

1,14 

110.9 

1.40 

.207 

Amount  by  Situation 

1,14 

•  10.1 

2.20 

.  190 

Rslevenoe  by  Situation 

1,14 

294.1 

1.97 

.219 

Amount  by  Relevance 
by  Situation 

1,14 

017.9 

3.29 

.092 

^7of7*n  *a%  ,"oo  n 


Important ")  for  "keeping  your  oyaa  on  tho  battlafialdH  to  2.94 
(3.0  «  "Average  Importance")  for  "insuring  standard  message 
formats. " 

natlngs  on  voice-based  versus  CCD  sods  for  assistance  in 
perforalng  selected  commend,  control  and  communication  functions 
were  polarised,  ee  expected.  Binomial  teste  on  voice  versus  CCD 
•usiatance  were  significant  for  11  of  the  13  functions  rated,  ee 
indicated  in  Table  10.  The  voioe-baied  mode  wee  rated  ee 
providing  significantly  mors  assistance  for  "expressing  message 
urgency"  end  "receiving  feedback  on  messages  received."  On  the 
other  hand,  participant  ratings  on  assistance  provided  by  the  CCD 
were  significantly  higher  than  voice-baaed  radio  for  nine  of  the 
selected  functions  assessed. 


Management  Exercises 


In  preface,  the  information  management  exercises  developed 
for  this  evaluation  successfully  standardized  end  manipulated 
information  amount  and  relevance,  as  sxpsctsd.  Data  obtained  on 
method  ohtoks  ars  provided  below  and  modlf ioationa  for  improved 
validity  and  general  liability  are  provided  in  the  Discussion  and 
Conclusions  sections. 
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Tibia  10 

Mean  Importance  of  Selected  Commend,  control,  end  Communication 
Function!  and  Preferred  Mode  (Voice  or  CCD)  based  on  Aeeletance 
Provided 


c*  runotion 

Zaportanoa 

Assistance 

Keeping  your  eyes  on  the  battlefield 

4.M 

(  .M) 

Voids 

Maintaining  situational  awaranaaa 

4.54 

(  .43) 

CCD 

M 

Ensuring  good  "copy"  of  the  aeeeege 

4 . 54 

(  .73) 

CCD 

as 

Linking  reported  locations  to  the  map 

4.31 

(  >72) 

CCD 

•  •• 

Expressing  message  urgency 

4.31 

(  .95) 

Voioa 

•  4 

Issuing  FKAGO  graphics 

4.13 

(1.02) 

CCD 

III 

Receiving  operational  overlaya 

4.13 

(  >95) 

CCD 

III 

Maintaining  map/ovarlay  alignaant 

3.94 

(  *45) 

CCD 

lei 

Relaying  messages  reoaived 

3.47 

(  >  50) 

CCD 

Receiving  feedback  aeeaage  receivad 

3.81 

(  •  46) 

Voioa 

e 

Providing  aaay  acoaaa  to  map  data 

3.81 

(  >83) 

CCD 

tee 

Saving/racording  measaga  content! 

3.44 

(  .81) 

CCD 

eat 

Ensuring  etandard  message  formats 

2.94 

(  .85) 

CCD 

eae 

flpte.  Mean  importance  ratinge  rank  ordered  with  standard 
deviatione  in  parentheses.  Importance  scale  anchors  ranged  from 
1  •  "Not  Important"  to  5  -  "Extremely  Important."  Voice  or  CCD 
mode  with  higher  aesietance  rating  is  indicated  by  function  and 
probability:  *  <  .05,  **  <  .01,  ***  <  .001.  N-16. 

Examination  of  the  message  locations  on  the  CCD  by  the 
authors  showed  they  concurred  with  designated  company  sector 
boundaries.  Participants'  relay  ratings  also  indicated 
successful  manipulation  of  information  relevance.  Overall  mean 
relay  ratings  for  low  versus  high  relevance  message  sets  were 
computed  for  pairwise  comparison  using  the  Wilcoxon  Matched-pairs 
Signed-ranks  test.  Relay  ratings  for  high  relevance  message  sets 
were  significantly  greater  than  low  relevance  sets  for  both  the 
Relay  To  ( £  »  -4.01,  two-tailed  p  <  .000)  and  Relay  By  (Z.  =  - 
3.96,  two-tailed  p  <  .000)  rating  categories. 
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Similarly,  across  platoon  leader  and  ooepany  commander 
participants,  mean  ralay  ratings  on  Ralay  To  category  war# 
significantly  hlghar  than  Ralay  By  rat  Inga.  Thaaa  ooaparlaona 
war*  baaad  on  Wilooxon  Matched-pairs  Signed-ranks  taata  with  £a 
ranging  from  -2.80  to  -2.93  and  all  two-tailad  pa  <  .0038. 

Tha  Manipulation  of  information  aaount  vaa  primarily 
dapandant  on  tha  ral lability  of  tha  8IHD  program  routlnaa 
davalopad  to  ayatamatioally  vary  tha  numbar  and  oontant  of 
maamagoa  in  aaoh  maiaaga  aat.  Thaaa  S8MD  routinaa  wara  alao 
daaignad  to  tranamlt  oountarbalanoad  maaaaga  aata  aimultanaoualy 
to  tha  four  participants  in  aaoh  group,  to  anaura  aaoh  aat  vaa 
axolualvaly  transmitted  on  aaoh  participants  daaignatad 
aimulator  radio  nat,  and  to  maintain  tha  f ixad-intarval  aohadula 
batwaan  tha  maaaagaa  in  aaoh  aat. 

Raviaw  of  tha  data  loggar  tranamiaaion  filaa  lndioatad 
ral labia  parformanaa  of  tha  SEND  routinaa.  All  but  ona  of  tha 
960  total  taat  transmissions  wara  auocaaaful  and  all  576  (9x4 
x  16)  common  aat  tranamiaaiona  wara  auocaaaful.  Tha  Iona 
tranamiaaion  failura  vaa  not  a  common  aat  maaaaga.  No  nat 
"blaadovar"  waa  datactod  indicating  partiolpanta  raoaivad  only 
tha  maaaagaa  assigned  to  thair  condition.  Fixad-Interval 
achadulaa  wara  maintained  within  three  aoconda,  considered 
acceptable .  Aa  intended,  tha  axarciaea  provided  approximately 
ona  minute  after  full-aat  tranamiaaion  to  complete  information 
management  requirements  and  prepare  for  aituational  awareness 
assessment. 


Discussion 

The  evaluation  reported  here  demonstrated  that  information 
amount  and  relevance  significantly  affected  the  performance  of 
participant  platoon  leaders  using  a  future  automated  C*  system. 
Although  an  initial  investigation,  a  number  of  key  findings 
emerged  that  should  provide  a  better  understanding  of  how  such 
systems  might  be  used  and  what  training  requirements  need  to  be 
addressed  by  future  information  management  training  programs. 
These  findings  are  discussed  in  greater  detail  throughout  this 
section  but  a  consolidated  preview  may  be  useful. 

The  higher  volume  of  information  anticipated  with  future  C2 
systems  may  have  serious  consequences  on  information  flow  and 
utility.  In  this  evaluation,  high  information  load  resulted  in 
reduced  awareness  of  battlefield  space  and  the  loss  of 
appropriate  information  to  platoon  leaders'  superiors  and 
subordinates.  More  specifically,  high  amount  participants  were 
less  accurate  in  their  knowledge  of  reported  enemy  and  friendly 
locations,  and  messages  that  should  have  been  relayed  were  not. 
On  the  other  hand,  low  amount  participants  relayed  too  much 
information. 
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Information  relevance  had  vary  pronounced  affects  on 
information  management  performance.  Less  relevant  information 
disrupted  the  flow  of  communication,  promoted  inappropriate 
relays  and  impaired  participants '  ability  to  accurately  "see" 
their  battlefield  situation.  More  specifically,  it  took 
participants  more  time  to  read  and  relay  low  relevance 
information  and  its  reception  caused  significantly  more  message 
deletion  activity.  Low  relevance  information  resulted  in 
inappropriate  relays  to  superiors  and  subordinates  and  lese 
accurate  comprehension  and  projection  of  the  platoon  leader's 
battlefield  situation. 

In  addition,  the  results  indicated  that  vehicle-based 
commanders  should  selectively  filter  information  they  revolve. 

By  restricting  relays  to  more  appropriate  messages,  commanders 
can  reduce  the  information  load  on  their  superiors  and 
subordinates.  Information  relevance,  based  on  proximity,  proved 
to  be  an  important  consideration  in  reducing  the  information 
management  requirements  of  the  platoon  leader,  his  superiors  and 
his  subordinates. 

Preference  for  automated  Ca  systems  over  voice  communications 
for  assisting  platoon  leaders  in  the  performance  of  important 
command,  control  and  communication  functions  was  strongly 
evidenced.  In  general,  high  amount  participants  were  more 
successful  than  expected  at  managing  higher  volumes  of 
information.  Their  performance  may  show  the  promise  of  automated 
C2  systems  to  distribute  and  display  battlefield  information 
rapidly  and  accurately.  The  requirement  for  complementary 
digital  and  voice  systems  was  reinforced.  Findings  related  to 
the  improvement  of  automated  C2  systems  are  identified, 
particularly  their  potential  for  eliminating  irrelevant 
communications  to  reduce  the  amount  of  information  to  be  managed. 

Several  important  training  issues  associated  with  future  C2 
systems  are  identified  based  on  participant  performance  and 
assessment.  Finally,  the  method  developed  for  standardising  and 
manipulating  information  amount  and  relevance  for  information 
management  exercises  appeared  successful.  Recommendations  for 
improvement  and  transfer  of  this  method  to  other  settings 
including  tank-based  automated  C2  systems  are  made. 

g.r9ap-fqulvfllepaB 

Results  on  the  success  of  random  assignment  for  the  two 
amount  conditions  indicated  that  differences  reported  are  not 
dependent  on  prior  differences  on  the  biographical  measures 
tested,  in  addition,  the  participant  platoon  leaders  concurrence 
with  SME  company  commanders  on  relay  ratings  indicated  they 
correctly  understood  the  platoon  leader  information  processing 
requirements  for  the  messages  employed  in  the  information 
management  exercises. 
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Learning-curve  data  was  not  obtained  and  the  effect  of 
extended  training  and  experience  on  a  system  as  innovative  as  the 
CCD  should  be  investigated.  In  this  evaluation,  "practice” 
effects  over  the  four  information  management  exercises  were 
minimal  and  the  exercises  were  counterbalanced.  Recall,  that 
participants  received  approximately  four  hours  of  training  in 
preparation  for  the  test  exercises.  However,  the  extended 
training  afforded  by  fielded  automated  C*  systems  might 
significantly  affect  information  management  performance. 

Despite  their  concurrence  with  company  commanders,  the 
limited  background  of  the  platoon  leader  participants  restricts 
generalization  of  the  results  to  the  population  of  experienced 
platoon  leaders.  The  literature  on  novice  versus  expert 
performance,  particularly  in  information  processing  contexts, 
has  consistently  demonstrated  significant  differences  in  skills, 
strategies  and  performance  (e.g..  Lord  and  Haher,  1991).  Future 
research  should  address  the  information  management  performance  of 
novice  versus  expert  platoon  leaders.  The  present  results  are 
more  indicative  of  the  automated  C1  training  and  performance 
issues  associated  with  novice  platoon  leaders,  a  condition  all- 
too-common  on  the  battlefield. 

Message  Processing  Accuracy 

Results  on  message  processing  accuracy  identified  likely 
problems  in  managing  information  with  automated  C*  systems.  In 
particular,  accuracy  data  on  relay  performance  versus  ratings 
suggested  the  perceived  "value"  of  information  is  relative  to 
information  load  and  that  load  determines  the  type  of  relay 
errors  made.  More  specifically,  whon  fewer  messages  are  received 
more  of  them  are  inappropriately  relayed  and  whon  more  mosaages 
are  received  too  few  of  them  are  relayed  Errors  in  relaying 
information,  particularly  over  relays,  are  compounded  when  low 
rslevanoe  information  is  received. 

Although  the  simulated  operational  setting  was  designed  to 
include  stressors  associated  with  the  "pace  of  operations"  and 
the  noed  to  maintain  situational  awareness,  many  other  strossors 
associated  with  actual  tactical  performance  were  not  simulated. 
Percentages  reported  on  inaccurate  relays  may,  therefore, 
underestimate  message  processing  errors. 

However,  the  data  on  inaccurate  relay  decisions  indicated 
that  overall  platoon  leaders  inappropriately  relayed  22.4%  of  the 
messagos  tested,  based  on  company  commander  relay  ratings.  In 
the  most  extreme  case,  low  amount  participants  and  low  relevance 
information,  participants  inappropriately  relayed  more  than  one- 
third  of  the  meaeegee  received.  This  tsndsncy  to  ovsr  relay 
battlefield  information  whan  equipped  with  an  automated  C1  system 
is  a  valid  concarn.  Even  experienced  tactical  commanders  ueing 
such  systems  relay  too  many  reports  Including  multiple  relays  of 
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the  same  report  to  the  earn#  receivers  (Ainslie  et  al.,  1991;  Du 
Bois  t  Smith,  1991). 

These  results  on  relay  accuracy  indicate  that  information 
management  training  for  future  automated  C2  sy stoma  may  be 
required  to  ensure  battlefield  information  is  appropriately 
disseminated.  As  these  systems  are  fielded,  commanders  and  units 
will  have  the  opportunity  to  develop  standardized  information 
management  procedures  that  may  result  in  more  accurate  message 
distribution.  Nevertheless,  information  management  training  for 
automated  C3  systems  should  address  the  demonstrated  potential  of 
such  systems  for  mismanagement  and  increased  information  load. 

An  additional  measure  of  message  processing  accuracy  was 
selection  of  the  correct  combat  net  for  message  relay.  While 
data  on  net  selection  errors  with  conventional  voice-based 
communication  systems  are  wanting,  admonishments  suoh  as  "you're 
on  the  wrong  net"  are  common  even  in  simulated  battlefield 
settings.  The  transition  from  conventional  voice-based  C2 
systems  to  an  electronic  information  delivery  system  marks  a 
significant  departure  in  communication  procedures.  With  voice- 
based  systems  users  provide  identifying  call  signs  at  the  start 
of  each  communication  and  identities  are  continuously  reinforced 
by  auditory  cues. 

The  data  on  net  selection  clearly  indicated  that  platoon 
leaders  relied  on  the  CCD's  default  routing  mechanism.  When  the 
default  net  was  wrong,  they  accepted  the  incorrect  net  one-fourth 
of  the  time,  with  the  dual-net  structure  available  to  most 
vehicle-based  commandors  such  incorrect  routing  would  result  in 
relay  of  the  same  message  back  to  its  source,  contributing  to  ths 
receiver's  information  load.  Data  were  not  obtained  on  net 
selection  errors  for  C2  systems  without  automatic  net  selection. 
Manual,  or  nonautomated  selection,  however,  might  result  in  more 
errors  and  slower  message  relays, 

Theso  findings  on  net  selection  errors  have  resulted  in 
several  modifications  to  the  CCD's  design  that  might  be  adopted 
for  future  automated  C2  systems.  The  CCD's  default  routing 
mechanism  was  revised  to  alternate  net  selection  for  messages 
relayed;  and  routing  cues,  such  as  sender  and  originator 
Identifiers,  were  provided  on  the  CCD's  Report  Aotion  Menu 
(Lavine  et  al.,  1993).  Design  modifications,  such  as  the 
elimination  of  duplicate  reports,  might  partially  counter  net 
selection  errors.  Information  management  training  programs, 
however,  should  address  the  demonstrated  potential  for  net 
selection  errors  on  future  automated  C2  systems. 

HflUtftflA  PrflSflfljilnq  Spflftd 

Results  on  message  processing  speed  indicated  some  potential 
problems  in  managing  information  with  automated  C2  systems.  For 
example,  high  amount  participants  took  less  time  to  read  messages 
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and  that  nay  account  for  thair  arrora  in  distributing  and 
encoding  information.  Recaption  of  low  relavance  messages  slowed 
tha  processing  of  information  as  avidanced  by  axtandad  raad  and 
relay  times.  Although  time  to  open  and  relay  sassages  did  not 
differ  by  amount,  as  tasted,  further  research  in  a  multi-task 
environment  ia  recommended. 

Processing  times  reported  for  this  evaluation  reflect  tha 
limited  operational  requirements  simulated  and  indicate  relative 
differences  between  the  conditions  tested.  Relation  of  the  times 
obtained  to  actual  battlefield  performance  is  discouraged. 
Nevertheless,  the  requirement  to  manage  battlefield  information 
rapidly  io  critical.  Platoon  leaders  in  the  high  amount 
condition  took,  on  the  average,  five  additional  seconds  to  open 
their  messages.  On  the  battlefield,  five-second  delays  may  have 
very  significant  consequences. 

The  more  variable  opening  times  for  the  high  amount  condition 
Indicated  some  participants  had  difficulty  in  "keeping  up"  with 
high  information  loads.  Overall,  participants  quickly  adjusted 
to  tha  fixed-interval  transmission  schedule.  For  low  amount 
participants,  their  schedule  seemed  to  provide  ample  time  for 
completion  of  message  processing  prior  to  reception  of  the  next 
message.  Whenever  possible,  high  amount  participants  appoared  to 
adopt  a  "oan  do"  mentality  that  allocated  message  processing 
requirements  to  time  available  prior  to  the  next  message.  As 
indicated  by  their  high  variability  on  message  opening  tines, 
however,  high  amount  participants  were  frequently  unable  to 
complete  all  message  processing  before  the  next  message  arrived. 

A  fixed-interval  transmission  schedule  does  not  realistically 
reflect  the  message  processing  requirements  on  a  battlefield. 
Clearly,  future  research  should  address  the  effects  of  variable- 
interval  schedules  on  such  requirements.  Although  not  adopted 
for  prototype  development  of  the  Information  management  exercise 
method,  variable-interval  software  routines  can  be  developed  on 
the  SEND  utility. 

Similarly,  commanders  in  full-mission  scenarios  have  many 
tasks  and  concerns  that  compete  with  information  management  and, 
in  particular,  message  opening  times.  Zn  a  simulated  defensive 
scenario,  for  example,  CCD-equipped  commanders'  average  median 
opening  times  ranged  from  23  to  72  seconds  across  the  Contact, 
Spot  and  Intelligence  report  types  (Leibrecht,  1992)  included  in 
this  evaluation.  These  full-mission  opening  times  reflect  the 
many  requirements  on  a  battlefield  commander  including  direct- 
fire  engagements.  In  contrast,  tha  dalay-in-sector  segment  used 
for  Initial  development  of  the  information  management  exercises 
targeted  a  post-engagement  phase  of  operation  that  realistically 
elevates  a  commander's  information  management  requirements. 

Information  amount  and  relevance  significantly  affected  the 
"read"  times  for  messages  relayed.  High  amount  participants 
spent  less  time  on  the  message  processing  activities  underlying 
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read  tin*  including  comprehension,  note-taking  and  relay 
dacieione.  Faster  read  tines  by  the  high  amount  participants  nay 
account  for  their  errors  in  not  relaying  sassages  they  should 
have  and  their  difficulty  in  plotting  reported  enemy  and  friendly 
locations. 

Relay  tine  data  suggested  that  high  amount  participants  were 
generally  able  to  disseminate  battlefield  information  as  rapidly 
as  the  low  anount  condition.  On  occasion,  however,  higher 
information  load  appeared  to  cause  significant  delays  in  nessage 
relays  as  indicated  by  the  greater  variability  of  the  high  amount 
condition.  Relay  times  in  a  multi-task  setting,  however,  might 
demonstrate  that  more  information  impedes  communication  flow  and 
that  training  strategies  for  reducing  information  load  are 
required. 

Massage  Processing  Actions 

Type  of  actions  taken  on  messages  differed  significantly  as  a 
function  of  information  amount  and  relevance.  Aa  with  message 
processing  accuracy,  data  on  the  frequency  of  message  relay  and 
deletion  indicated  the  "value”  of  information  is  relative  to  its 
load.  More  specifically,  low  amount  participants  relayed  more 
messages  and  deleted  fewer.  Given  the  very  discrepant  actions 
taken  by  low  versus  high  amount  participants  on  idontioal 
messages,  the  effect  of  information  amount  on  information 
management  performance  was  striking. 

An  alternate  explanation  for  these  discrepancies  is  that  the 
additional  messages  received  by  the  high  amount  condition 
provided  information  redundant  to  the  common  subset  of  nine 
messages.  However,  the  development  of  message  sets  for  this 
initial  evaluation  was  directed  by  a  deliberate  decision  to  avoid 
duplicate  messagee,  redundant  information  and  disinformation. 
Armor  SMEs  who  developed  the  message  sets  conscientiously 
attempted  to  abide  with  that  decision. 

A  substantive  distinction  between  common  set  and  additional 
messages  was  their  respective  provision  of  information  on  the 
enemy's  main  unit  versus  supporting  subunits.  To  ensure  a 
comprehensive  description  of  each  battlefield  situation  in  a  set 
of  nine  messages,  the  common  set  addressed  more  global  aspects  of 
the  situation,  particularly  the  activities  of  the  enemy's  main 
unit.  Additional  messages  received  by  high  amount  participants 
generally  provided  information  on  subunits  acting  in  accordance 
with  the  main  unit's  attack.  A  reduction  in  the  relay  of  subunit 
information,  givan  main  unit  reports,  might  be  expected.  But 
reported  differences  on  message  processing  actions  are  based  only 
on  common  set  massages,  essentially  main  unit  information. 

The  authors  support  the  interpretation  that  the  reported 
effects  of  information  amount  on  relay  and  deletion  are  not  due 
to  information  redundancy  and  the  content  of  all  message  sets  is 
available  for  review  (Appendix  B) .  Depending  on  training  or 
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•valuation  objectives,  future  efforts  on  inforaation  management 
night  investigate  the  effects  of  duplicate  massages,  redundant 
information  and  disinformation.  Such  communications  are  conaon 
on  the  battlefield. 

Information  relevance  effects  on  actions  taken  demonstrated 
that  messages  from  the  high  relevance  sets  were  more  frequently 
relayed  and  less  likely  to  be  deleted.  In  fact,  no  messages  from 
the  high  relevance  message  sets  were  deleted  by  participants  in 
the  low  amount  condition.  Similarly,  messages  from  the  high 
relevance  message  sets  were  less  likely  to  receive  no  action. 

The  results  strongly  suggest  that  inforaation  relevance  is  a 
critical  factor  in  future  efforts  to  reduce  information 
management  requirements. 

The  prospect  of  automated  C*  systems  swamping  vehicle-based 
commanders  in  a  flood  of  Information,  particularly  irrelevant 
information,  is  a  primary  concern.  Future  front-end  analyses  on 
message  routing  and  filtering  for  suoh  systems  must  consider  more 
than  message  type  and  source.  The  findings  on  relay  and  deletion 
actions  demonstrated  that  information  relevance  has  significant 
effeot.s  on  information  management  and  that  parent  unit's  sector 
(e.g.,  company)  is  an  effective  basis  for  defining  relevanoe. 

In  addition  to  proximity,  other  faotors  that  might  be 
included  in  considerations  of  relevanoe  are  the  size,  alignment, 
type  and  heading  of  the  reported  unit.  Training  issues  aside, 
dseign  modifications  in  automated  C*  systems  night  employ 
automated  relays  and  message  filtering  based  on  these  relevanoe 
factors  to  rsduca  ths  information  management  requirements  of 
future  vehicle-based  commanders. 

Based  on  the  Relay  To  versus  Rslay  By  rating  comparisons,  ths 
echelon  of  a  receiver  also  clearly  affects  information  relevanoe. 
Recall ,  these  comparisons  indlcatsd  significantly  mors  of  ths 
same  maeeagao  ware  appropriats  for  platoon  loader's  rscsption 
than  hie  relay,  particularly  for  low  relevance  message  sets. 
Training  programs  on  information  management  should  stress 
information  relevance  (see  Winsch  at  el.,  in  preparation)  and 
enaurs  that  communicator's  understanding  of  information 
requirements  is  evldsnced  in  performanos. 

Limitad  uae  of  the  Old  Files  wee  consistent  with  the 
relatively  brief  duration  of  the  information  management  exercises 
and  the  absence  of  competing  task  requirements.  Old  Filss  wsrs 
used  exclusively  by  the  low  amount  participants  and  primarily  for 
"policing"  their  CCD'a  via  message  deletions.  The  ability  of 
high  amount  participants  to  delete  messages  "on  the  fly"  from  the 
Receive  Queue  was  clearly  evident.  The  disposal  of  unnecessary 
messages  is  an  important  requirement  for  managing  information 
effectively,  particularly  with  the  provision  of  digital  copies  by 
automated  C*  systems,  Information  can  becomo  obsolete  quickly  on 
a  dynamic  battlefield, 
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Results  on  situational  awareness  were  mixed  but  informative. 
Higher  amounts  of  information  impaired  the  platoon  leader's 
ability  to  plot  reported  enemy  and  friendly  locations.  This 
ability  is  fundamental  to  a  combatant's  understanding  of  the 
battlefield  space  constraints  on  and  opportunities  for  maneuver 
and  engagement.  Additionally,  less  relevant  information  reduced 
comprehension  and  projection  of  the  platoon  leader's  battlefield 
situation. 

As  evidenced  by  "read11  time  differences,  low  amount 
participants  spent  significantly  more  time  reading  and  taking 
notes  on  messages  received.  Perhaps,  this  extra  time  enabled 
them  to  encode  the  reported  locations  more  accurately.  The  less 
accurate  plotting  performance  by  high  amount  participants  might 
also  be  attributed  to  interference  from  additional  messages  and 
locations.  Contrary  to  expectation,  plotting  performance  on  high 
relevance  message  sets  was  no  better  than  that  for  low  relevance 
sets. 

No  predictions  were  made  on  differences  between  current  and 
future  battlefield  situation  performance  and  no  such  differences 
wore  detected,  a  trend  for  more  accurate  plotting  on  the  future 
battlefield  situation  was  apparent.  Given  the  delay-in-sector 
vignette  used,  greater  concern  with  the  future  situation  seems 
reasonable.  Reported  locations  for  this  situation  included 
obstacles  and  enemy  units  that  might  directly  impact  displacement 
to  the  subsequent  battle  position.  In  contrast,  many  of  the 
current  situation  reports  conveyed  less  threatening  information 
summarizing  enemy  units  destroyed  or  damaged. 

Participants'  ability  to  "Bea,,  the  battlefield  was  not 
significantly  affected  by  information  amount,  as  tested.  In 
contrast  to  the  discrete  locations  required  for  plotting,  the 
questions  developed  to  measure  seeing  performance  were 
assimilative.  They  required  participants  to  consolidate 
information  across  messages.  Though  unintended,  the  additional 
(to  the  common  set)  messages  received  by  the  high  amount 
participants  may  have  reinforced  their  comprehension  and 
projection  of  the  battlefield  situation.  These  additional 
messages  provided  high  amount  participants  auxiliary  information 
such  as  enemy  subunits'  location  and  heading  that  may  have 
contributed  to  their  understanding  of  the  main  unit's  force 
structure  and  intent. 

Information  relevance  significantly  affected  platoon  leaders' 
seeing  performance.  Less  relevant  information  reduced  their 
ability  to  comprehend  the  battlefield  situation  and  their  ability 
to  project  how  the  information  reported  might  impact  the  future 
batt) afield  situation.  These  results  suggest  reduction  in  low 
relevance  information  would  aid  the  platoon  leader's  ability  to 
see  the  battlefield. 
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Ancillary  Measures 


Self-ratings  on  situational  awareness  and  workload  were 
indifferent  to  information  amount  and  relevance.  Information 
amount  effects,  in  particular,  should  be  reassessed  as  a  within 
subjects  factor. 

Ratings  on  the  assistance  provided  by  conventional  voice 
versus  digital,  or  CCD,  communication  systems  for  selected 
command,  control  and  communication  functions  were  highly 
discriminate.  Voice  radio  was  strongly  preferred  for  "expressing 
message  urgency"  and  "receiving  feedback  on  messages  received." 
Most  participants  also  rated  the  voice  mode  better  for  "keeping 
your  eyes  on  the  battlefield." 

On  the  other  hand,  participant  ratings  indicated  the  CCD 
provides  significantly  more  assistance  than  voice  radio  for  9  of 
the  13  functions  assessed.  The  importance  ratings  associated 
with  these  CCD  preferred  functions  indicated  the  participants 
perceived  them  as  "Very  Important"  to  "Extremely  Important." 

These  results  indicated  limitations  with  current  voice-based 
communications  and  the  need  for  complementary  voice  and  digital 
modes  to  support  important  command,  control  and  communication 
functions. 

Method  Checks  on  Information  Management  Exercises 

Checks  on  information  amount  and  relevance  indicated  the 
information  management  exercises  successfully  manipulated  these 
variables  in  a  simulated  operational  setting.  As  noted,  the 
manipulation  of  information  amount  was  dependent  on  software 
routines  developed  for  delivery  of  the  information  management 
exercises.  Successful  checks  on  these  routines  included 
information  amount,  rate  of  transmission,  net  "bleedover"  and 
simultaneous  transmission  of  message  sets  in  counterbalanced 
order. 

The  manipulation  of  information  relevance  based  on  company 
sector  also  appeared  successful.  While  objective  data  on  platoon 
leader  information  management  demonstrated  relevance  effects,  the 
subjective  data  on  relay  ratings  may  be  of  special  interest. 

This  rating  data  was  obtained  from  both  company  commanders  and 
platoon  leaders  in  a  nonoperational  setting  expected  to  reduce 
rating  error.  For  both  Relay  To  and  Relay  By  categories, 
comparisons  demonstrated  significantly  lower  information 
requirements  for  low  relevance  message  sets. 

The  relay  rating  data  also  reinforced  the  evaluation's 
concern  with  the  information  management  requirement  to  reduce 
information  load.  Significantly  higher  ratings  by  platoon 
leaders  and  company  commanders  on  Relay  To  versus  Relay  By 
ratings  underscore  the  need  for  tactical  commanders  such  as 
platoon  leaders  to  filter  battlefield  communications.  The 
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differences  obtained  forcefully  demonstrated  the  receiver's 
requirement  to  relay  information  selectively. 

In  conclusion/  results  on  the  manipulation  checks  are 
encouraging  as  methods  for  rapidly  generating  and  varying 
information  amount  and  relevance  may  be  useful  for  future  C* 
training  and  assessment  efforts.  To  support  such  efforts,  the 
software  routines  and  message  files  developed  for  this  evaluation 
are  documented  (Lickteig,  1991)  and  resident  in  the  MWTB's  SEND 
utility.  The  information  management  exercise  aothod  oan  be 
transferred  to  other  simulation-based  training  and  assessment 
environments  such  as  the  Mounted  Warfare  simulation  Training 
Center  at  Fort  Knox  or  the  proposed  Close  Combat  Tactical  Trainer 
(CCTT) ,  currently  under  development.  Given  the  computer-based 
nature  of  automated  C*  systems,  similar  exercises  could  be 
adapted  for  embedded  training  on  operational  equipment. 

Conclusions 

The  evaluation  demonstrated  that  information  amount  and 
relevance  had  significant  effects  on  the  information  management 
performance  of  platoon  leaders  equipped  with  autometed  C* 
systems.  Higher  amounts  of  information  reduced  the  platoon 
leader's  awareness  of  battlefield  space  and  resulted  in  the  loss 
of  appropriate  information  to  superiors  and  subordinates.  The 
volume  of  messages  received  also  affacted  the  perceived  "value” 
of  information  as  indicated  by  the  type  of  relay  errors  made. 

bess  relevant  information  disrupted  the  flow  of 
communication,  promoted  inappropriate  relays  and  Impaired 
participants'  ability  to  "see"  their  battlefield  situation. 
Information  relevance,  based  on  proximity  to  the  parent  unit, 
reduced  the  information  management  requirements  of  the  platoon 
leader,  his  superiors  and  his  subordinates. 

The  ability  of  automated  C1  systems  to  assist  platoon  leaders 
in  the  performance  of  key  command,  control  and  communication 
functions  was  evidenced  by  participant  performance  end 
assessment.  High  amount  participants  wera  mora  successful  then 
expected  at  managing  higher  volumes  of  information.  Thoir 
performance  may  support  ths  potsntial  of  automatsd  C*  systems  to 
distribute  and  display  battlefield  information  rapidly  and 
accurately.  Participants  preferred  automated  C1  systems  over 
conventional  voice-based  communication  systems  for  s  variety  of 
command,  control  and  communication  funotiona  rated  as  vary 
important.  Shortcomings  with  oonvantional  voles  communications 
were  identified  and  tha  need  for  complementary  digital  and  voice 
systems  was  reinforced. 

A  conventional  voice  condition  was  not  included  In  the 
evaluation.  However,  informal  assessments  have  indicated  that 
when  using  voice  radio  and  proper  authentication  and  '’break" 
procedures,  platoon  leaders  could  not  even  receive  the  21 
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messages  included  in  the  high  amount  condition  in  the  10-minute 
exercise  interval.  Subsequent  relay  of  the  information,  an 
information  management  requirement  met  by  the  participants,  might 
require  an  equivalent  amount  of  time  using  voice-based 
communication  systems.  These  informal  assessments  did  not 
attempt  to  measure  the  accuracy  of  voice  relays  for  the  subject 
message  sets.  Formal  evaluations,  however,  have  repeatedly 
demonstrated  that  voice  communications  are  significantly  less 
accurate  than  digital  battlefield  reporting  (Leibreoht  et  al., 

29 921  O'Brien  et  al.,  1992). 

Numerous  issuss  related  to  the  training  and  assessment  of 
information  management  with  automated  C*  systems  were  identified. 
Training  programs  must  address  the  demonstrated  potential  of  such 
aystems  for  information  overload  and  mismanagement.  Particular 
concerns  are  the  effects  of  information  amount  and  relevance  on 
relay  errors  and  information  processing  speed.  Training  programs 
should  stress  the  receiver's  responsibility  to  filter  information 
and  how  consideration  of  information  relevance  might  reduce 
information  load  on  superiors  and  subordinates. 

Limitations  in  the  evaluation  and  the  prototype  method 
developed  for  providing  information  management  exercises  were 
recognised.  Future  modifications  to  the  method  might  address 
validity  issues  such  as  variable-interval  transmission  schedules, 
misleading  and  redundant  information,  and  a  multi-task 
environment.  For  greater  generalisation,  method  modifications 
might  include  other  command  and  staff  duty  positions,  different 
missions  end  all  mission  phases— planning,  preparation, 
execution. 

As  demonstrated,  the  method  developed  for  delivering 
information  management  exerolees  provides  an  affective  and 
efficient  approach  for  rapidly  generating  battlefield  conditions 
and  information  flow  to  enable  future  commanders  to  hone  their 
information  management  skills.  The  method's  use  of  surrogate 
communicators  could  substantially  reduce  personnel  and  equipment 
requirements  for  Information  management  training.  This  method 
uan  be  adapted  for  other  training  settings  and  embedded  in  future 
C1  systems. 

Finally,  this  method  for  delivery  and  manipulation  of 
information  management  exercises  should  enable  trainers  to  tailor 
training  programs  for  wwnauing  battlefield  information.  The 
ability  to  customise  training  supporte  tha  sometimes  conf Hating 
requirements  for  eollder,  leader,  etaff  and  unit  readineee  in 
aut  ive  and  reserve  component  forces.  Uuoh  readiness  may  be 
required  to  win  the  "information  war"  on  the  future  battlefield. 
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APPENDIX  A 


•AMPLE  CONTROLLER'S  LOO 

Controller's  Log  for  Information  Management  Exorcises 

Controller,  this  schedule  for  participants  13-16  designates  by 
session  and  participant  (g)  number;  simulator  ZD,  information 
relevanoe  level,  simulator  location,  and  the  counterbalanced 
order  of  SEND  files  for  information  management  exeroises  and 
overlays  as  veil  as  support  staff's  administration  of  situational 
awareness  questionnaires. 

Low  Information  Amount  (LA) 
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APPENDIX  B 


TEST  MESSAGE  SETS  FOR  PLATOON  LEADERS 
Message  sets  for  vignette  1:  Low  Relevance,  Location  Aa 
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Hots.  Ob*  ■  observed;  Dan  •  damaged;  Des  •  destroyed;  Dir  “  direction;  Co  •  enemy;  T r  *  friendly; 

A*  Of  -  minutes;  PC  •  personnel  earriar;  Set  ■  scout;  Trp  *  troops;  Halo  •  hcliooptar;  Trek  ■  truck; 

C2  “  conmand  and  control;  Hack  *  mechanised  infantry;  Mort  -  mortar;  rw  -  fixed  Mint  air;  Tnk  •  tenki 
ATOM  •  anti-tank  guided  aissila;  Supt  -  support;  Atk  •  ground  attack;  Astk  ■  air  sttsek;  Dsf  •  defend; 

Rac  *  reconnaissance;  Art  -  artillery ;  Bln  Bdg  *  blown  bridge;  tu  ■  nut  reported. 

*  Own  location  “  ES63687S.  All  othar  sap  locations  have  U  prefix. 

b  L  -  messages  used  in  low  amount  (LA)  set.  All  messages  listed  in  order  presented. 

c  Minefield  and  dltcb  locations  equal  center  of  mass,  but  commanders  received  coordinates  tor  eseb  midpoint. 
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Mosoa go  Sots  for  Vignotto  2t  High  Rolovonco,  Location  A* 
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Message  Sets  for  Vignette  3:  Low  Relevance,  Location  B* 
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Hot* .  Obi  ■  obaarved;  Dm  “  dau|ri;  Da*  -  daatroytd;  Dir  ■  direction;  En  -  aneoy;  fr  "  friendly; 

Ai  Of  “  minutea;  K  ■  paraotmel  earriar;  Set  -  acout;  Trp  -  troop*;  Balo  -  helicopter;  Trek  -  truck: 

C*  "  coomand  and  control;  Mach  •  •ecbenited  infantry ;  Mort  -  cottar;  FW  -  fixed  win*  air;  tnk  ■  tank; 

ATOM  •  anti-tank  *uld*d  cciaaile;  Supt  ■  lupport;  Atk  “  (round  attack;  AAtk  •  air  attack;  Daf  ■  defend; 

*eo  “  recormaiaaance;  Art  •  artillery;  Bln  Bd*  ■  blown  brld*a;  nr  •  not  reported. 

*  Om  location  •  ES879797.  All  otbar  sap  location*  have  ES  prefix. 

**  L  “  naaaa***  uaad  in  low  Mount  (LA)  aat.  All  Miaa|«s  llatad  in  order  praaantad. 

c  Minefield  and  diteb  location*  equal  center  of  a***,  but  coooandere  received  coordinate*  for  each  endpoint . 
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Message  Sete  for  Vignette  4i  High  Relevance,  Location  B* 
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PT  5859(a) 
PI (8)  1  Of  2 


SITUATIONAL  AMARENE88  MEASURES 


Situational  Awareness i  "feeing"  the  currant  situation 


Tha  following  quaationa  ask  about  your  awareness  of  tha 
currant  situation.  Tha  first  two  quaationa  asx  about  units 
reportedly  engaged  by  your  aonnan* .  Tha  naxt  two  quaationa  aak 
about  tha  as in  anany  unit  reported  but  engaged  by  your 
oonpany.  Tha  final  question  aaka  your  aaaaaanant  of  tha  total 
unit  ooanlttad  agalnat  tha  antlra  Talk  loros  baaad  on  all  raporta 
raoalvad.  For  aaoh  ltan,  althar  wrlta  your  anawar  in  tha  blank 
provided,  or  olrola  tha  one  latter  indicating  tha  beat  anawar. 

1.  Saaad  on  tha  raporta  aant  to  you,  how  aany  vehicles  by  type 
ware  danagad  or  destroyed  in  your  eoanaav  sector  by  your  oonpany? 
Tha  nuabers  you  enter  should  Indicate  tha  total  nunber  of 
vehicles  by  type  raportadly  destroyed  or  danagad  by  your  oonpany. 

TYPE  NUMBER 

Tank  _ 

PCs  _ 


Other 


7Tp«rfy) 


2.  Based  on  tha  nuabers  and  types  of  vehicles  raportad  aa 
destroyed  and  daaagad  in  your  onanany  sector  (question  1), 
estimate  tha  alia  and  type  of  anaay  force  your  eeananv  engaged? 


a. 

Mechanised  Rifle  Coapany 

(MRC) 

b. 

Mechanised  Rifle  Battalion  (MKI) 

0. 

Mechanised  Rifle  Rsglssnt 

(MRK) 

d. 

Tank  Coapany 

a. 

Tank  Battalion 

f . 

Tank  Rag  1 nan t 

PT  5859(a) 
1(S)  2  Of  2 

3 .  Based  on  the  reports  sent  to  you,  how  many  and  what  type  of 
vehicles  that  were  not  engaged  are  still  approaching  to  the  front 
of  your  company • s  position? 

TYPE  NUMBER 

Tank  _ 


PCs 


Other  _ 

(Specify) 


4.  Based  on  the  numbers  and  types  of  vehicles  reported 
approaching  your  company  position  but  not  engaged  (question  3), 
estimate  what  size  and  type  of  unit  is  still  approaching? 

a.  Mechanized  Rifle  Company  (MRC) 

b.  Mechanized  Rifle  Battalion  (MRB) 

c.  Mechanized  Rifle  Regiment  (MRR) 

d.  Tank  company 

e.  Tank  Battalion 

f.  Tank  Regiment 

5.  Based  on  all  reports  received,  what  is  your  estimate  of  the 
overall  size  and  type  of  unit  committed  against  the  Task  Force? 

a.  Mechanized  Rifle  Company  (MRC) 

b.  Mechanized  Rifle  Battalion  (MRB) 

c.  Mechanized  Rifle  Regiment  (MRR) 

d .  Tank  Company 

e.  Tank  Battalion 

f.  Tank  Regiment 


************* *  *FOR  RESEARCHERS  ONLY************* 

FI  ( S )  (1)  S# _ (2)  Sim  #  2B  3B  4A  4B  5th  sim 

(3)  Vigm  Practice  A  B  C  D  (4)  Amount:  H  M  L 
(5)  Date:  _  (6)  RA  _ 
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PT  585V (b) 
F2(S)  1  of  2 


Situational  Avar ana act  "Baaing"  tba  Future  Situation 


The  following  questions  ask  about  your  awareness  of  the 
future  situation.  The  first  two  questions  ask  about  the  main 
unit  reported  to  your  company • a  front.  The  third  question  asks 
about  your  estimate  of  when  that  unit  may  reach  your  currant 
vehicle's  position.  And  the  final  two  questions  ask  about  the 
distance  and  direction  to  your  company • a  designated  subsequent 
battle  position,  and  the  impact  reported  obstacle (s)  may  have  on 
your  company's  movement  to  its  subsequent  battle  position.  For 
each  item,  either  write  your  answer  in  the  blank  provided,  or 
circle  the  one  letter  indicating  the  best  answer. 

1.  From  your  vehicle's  current  position,  how  far  in  kilometers 
(km)  and  in  what  direction  is  the  main  unit  not  encaged  that  is 
approaching  your  company • s  front? 

DISTANCE  (to  1/2  km)  from  your  current  position? _ km 

DIRECTION  (N/NE/etc)  from  your  current  position? 


2.  HEADING  (N/NE/etc.)  of  main  unit?  _ 

3.  Based  on  a  speed  of  10  kilometers  per  hour,  how  many  minutes 
should  it  take  the  main  enemy  unit  (question  1)  to  move  from  its 
reported  location  to  within  2  kilometers  of  your  vehicle's 
current  position? 

a.  Unit  will  not  come  within  2  kilometers  of  my  position. 

b.  Six  minutes. 

c.  Twelve  minutes. 

d.  Eighteen  minutes. 

e.  Twenty-four  minutes. 

4.  From  your  vehicle's  current  position,  how  far  and  in  what 
direction  is  your  oompany ' s  subsequent  battle  position? 

DISTANCE  (to  1/2  km)  from  your  current  position?  _ km 

DIRECTION  (N/NE/etc)  from  your  current  position?  _ 
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FT  5859(b) 
F2 (S)  2  of  2 


5.  What  Inpaofc  will  tha  reported  obataola (a)  hava  on  your 

Mmmt  %&  oooupatloa  pf  your  designated  aubaaquant 
battla  position. 

a.  No  inpact. 

b.  Tha  obataola  is  on  ny  designated  aubaaquant  battla 

position,  I  will  hava  to  designate  a  naw  aubaaquant 
battla  position. 

c.  Tha  obataola  ia  vary  oloaa  to  ny  dasignatad  aubaaquant 

battla  position.  My  unit  will  hava  to  ba  caraful  in 
occupying  tha  position. 

d.  Tha  obataola  is  on  tha  primary  high  apaad  routa  to  ny 

dasignatad  aubaaquant  battla  position, 
a.  The  obstacle  ia  not  ori  tha  routa  but  will  canal iza  ny 
unit's  movement  to  ny  dasignatad  aubaaquant  battla 
position. 


***************  for  researchers  only************* 

F2(S)  (1)  S#  _  (2)  Sim  #  2B  38  4A  4B  5th  sim 

(3)  Vign:  Practice  A  B  C  D  (4)  Amount:  H  M  L 
(5)  Date:  _  (6)  RA  _ 
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FT  4A60(«) 
F2(P)  1  Of  1 

Situational  Awareness i  t lotting  the  Currant  Situation 

Based  on  ths  information  you  racalvad  on  your  Conaand  and 
Control  Display  (CCD)  during  this  vignette,  plot  tha  locations  of 
tha  itans  listed  balov  on  tha  nap  (hast  provided.  You  are  to  plot 
tha  actual  location  as  last  reported .  not  a  projected  location 
auoh  as  where  unit  nay  have  noved  to  since  report  reception. 

As  accurately  as  possible,  for  each  of  the  iteao  listed  balowi 

(a)  plot  its  looation  with  an  "XM  on  the  aap  sheet,  and 

(b)  write  the  itea  number  beside  the  X  (e.g.  “XI, H  •'«••) 

On  this  page,  below  each  itea,  indicate  with  an  "XN  on  the 
appropriate  line  that  you  either  (a)  plotted  the  itea  and 
apeolfied  number  on  the  aap  sheet,  or  that  you  did  not  plot  the 
item  because  (b)  it  was  not  reported  or  provided,  or  (o)  you  can 
not  remember  its  reported  or  provided  looation. 

1.  largest  enemy  unit  anoaoed  by  your  company 

(a)  _ _  plottod  and  numberad 

(b)  _ _  not  plotted,  not  reportad 

(c)  _  not  plotted,  can't  recall  looation 

2.  lorgeet  enemy  unit  approaching  the  front  of  your  company 
sector,  but  not  engaged 

(a)  _  plotted  end  numbered 

(b)  _  not  plotted,  not  reported 

(c)  _  not  plotted,  can't  recall  location 

3.  friendly  scout  unit  to  front  of  your  company  eaotor 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  reported 

(c)  _  not  plotted,  can't  recall  looation 

4.  target  reference  pointe  (TRPe)  to  front  of  your  company  sector 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  provided 

(c)  _  not  plotted,  can't  reuail  location 

5.  largest  enemy  unit  pMtllfll  of  your  flgjapm  sector 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  provided 

(c)  _  not  plotted,  can't  recall  location 

***************  FOR  RESEARCHERS  ONLY* *******  ******* 

F2(P)  (1)  S#  _  (2)  Sim  #  2B  3B  4A  4B  5th  elm 

(3)  Vignj  Practice  A  B  C  D  (4)  Amount!  H  M  L 
(5)  Date:  _  (6)  PA _ 


C-5 


PT  5860(b) 

FI (P)  1  of  1 

Situational  Awareness*  Plotting  tha  Putura  Situation 

Based  on  the  information  you  received  on  your  Command  and 
Control  Display  (CCD)  during  this  vignette,  plot  the  locations  of 
the  items  listed  below  on  the  map  sheet  provided.  You  are  to  plot 
the  actual  location  as  last  reported .  not  a  projected  location 
such  as  where  unit  may  have  moved  to  since  report  reception. 

As  accurately  as  possible,  for  each  of  the  items  listed  below: 

(a)  plot  its  location  with  an  "X"  on  the  map  sheet,  and 

(b)  write  the  item  number  beside  the  X  (e.g.  "Xl,”  ”X2”) 

On  this  page,  below  each  item,  indicate  with  an  nX"  on  the 
appropriate  line  that  you  either  (a)  plotted  the  item  and 
specified  number  on  the  map  sheet,  or  that  you  did  not  plot  the 
item  because  (b)  it  was  not  reported  or  provided,  or  (c)  you  can 
not  remember  its  reported  or  provided  location. 

1.  support  unit  to  rear  of  your  company  sector 

(al)  _  plotted  and  numbered;  give  type  (a2) _ 

(b)  _  not  plotted,  not  reported 

(c)  _  not  plotted,  can't  recall  location 

2.  your  company's  subsequent  battle  position 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  provided 

(c)  _  not  plotted,  can't  recall  location 

3.  obstacle  to  rear  of  your  company  sector 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  provided 

(c)  _  not  plotted,  can't  recall  location 

4.  enemy  scout  unit  to  rear  of  your  oompan,  sector 

(a)  _  plotted  and  numbered 

(b)  _  not  plotted,  not  reported 

(c)  _  not  plotted,  can't  recall  location 

5.  friendly  mortar  unit  in  your  company  sector 

(al)  _  plotted  and  numbered;  give  type  (a2) _ 

(b)  _  not  plotted,  not  reported 

(c)  _  not  plotted,  can't  recall  location 

***************  FOR  RESEARCHERS  ONLY*************** 

F1(P)  (1)  S#  _  (2)  Sim  #  2B  3B  4A  4B  5th  siro 

(3)  Vign:  Practice  A  B  C  D  (4)  Amount:  H  M  L 
(5)  Date:  _  (6)  RA  _ 
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APPENDIX  D 


SCORING  GUIDELINES  FOR  SITUATIONAL  AWARENESS  MEASURES 

Scoring  for  each  item  based  on  10-point  scale:  10  **  High,  6  » 
Medium,  2  -  Low,  0  -  <  Low. 

Summary  score  based  on  percentage  of  available  points  obtained  on 
each  form  for  each  vignette. 

Plotting  Items «  Form  1(F)/  Future  Situation; 

Form  2(F),  Current  Situation 

If  information  provided  and  plotted*: 

10  -  .5km  from  exact  location 

6  =  >.5  to  1.5km  from  exact  location 
2  *=  >  1.5  to  3km  from  exact  location 
0  =  >  3km  from  exact  location;  ieported,  not  plotted 

*  If  more  than  one  element  plotted/item  (eg.,  more  than  1 
obstacle)  assign  equal  weight  for  each  element  with  total  points 
divided  by  number  of  elements  plotted. 

If  information  not  plotted,  because  it  was  not  provided: 

5  -  "B"  (not  plotted,  not  reported) 

3  -  "C"  (not  plotted,  can't  recall) 

If  information  plotted,  but  not  provided 
0  -  "A"  (plotted,  but  not  provided) 

If  information  provided,  but  not  plotted: 

0  ■  "B"  or  "C" 

"Seeing"  items:  Form  1(8)/  current  situation 

Items  1  and  3  under  NUMBER  for  Tank  and  PCS  are  I  of  vehicles  for 
each  type.  Scoring  based  on  correct  #  reported.  Allot  80%  for 
total  #  of  tanks  and  PCs  reportedly  engaged  (.0  x  I  of  points 
allotted) . 

10  -  90%  or  > 

6  -  70-89% 

2  -  40-691 

0  »  <  40% 

Items  l  and  3  under  OTHER  for  Type  and  Number  are  I  of  vehicles 
by  type  other  than  tanks  and  PCs.  All  OTHERS,  if  present  in  the 
message  set,  together  account  for  20%  (.2  x  I  of  points 
allotted).  If  two  "other”  subtypes,  weighted  by  .1,  eto, 


D-l 


Scoring  Guidelines  for  Situational  Awareness,  oont. 

Items  1  and  3  under  OTHER  oont. 

10  -  correct  type  and  correct  number 
6  -  correct  type,  but  incorrect  number 
2  -  incorrect  type,  but  correct  number 
o  -  incorrect  type  and  incorrect  number 

••fleeing**  zteasi  Form  1(f)#  Current  situation,  oont* 

Items  2,  4  and  6  are  unit  fllie  and  Type 
10  -  correct  echelon  and  type 
6  -  adjacent  echelon  and  correot  type 

or  correot  echelon,  but  incorrect  type 
2  -  nonadjacent  echelon  and  correct  type 
or  adjacent  echelon  and  incorrect  type 
0  -  incorreot  echelon  and  type 

••fleeing"  zteasi  Form  !(•)<  Future  Situation 

Items  l  snd  4  Distance  and  Direction  (Cardinal  Directions  (CD)) 
10  -  5  <  .Ska  from  exact  location  4  B  for  correct  CD 

6  —  3  >  . D-l.Bkn  fron  exact  location  4  3  for  adjacent  Cl) 

2  -  1  >  1.8  km-3kn  fron  exact  location  #1  for  next  adjacent  CD 

0  •  >  3km  fron  exact  location  or  >  SO  degrees  fiun  cut  tout  GO 

(Different  point  combinations  possible) 

item  a  Heeding  (cardinal  Directions  (CD)) 

10  -  oorreot  CD  for  direction 
6  -  ad) scant  CD  (4B  deureee  from  correct  cti) 

2  -  next  edjeoent  CD  (10  degrees  from  oorreut  CD) 
o  -  >  bo  degrees  fron  oorreot  CD 

Itoe  3  Time 
10  -  correct 
6-0  minutes  off 
2-12  minutes  off 
0  -  x  13  minutes  off 

Item  b  obet suit  impact 
10  -  correct 
6  -  closest  option* 

2  -  next  closest  option 
o  -  other 

*  Options  and  uuiiaut  answeio  as  dale) mined  by  eubjeui  mailer 
experts  (MHKs) . 
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APPfcHDlX  I 
ANCXMAHY  MEAJUHK0 

MkliiUa  M  lituitiaul  MiriMii  A  lorklDii 

l,  Provlda  an  «atlo«t«  of  your  aituitlbhal  Awaranoan, 
u  nil  a  r  a  Unding  of  tha  tautloal  aHuatlon,  for  thl*  vlgnatta  by 
cliullng  ih*  appropilata  numbar  (l-t)  bolow. 


Ho  Avorofo  Comp lata 

Awmranooi  Awaronaik  Aworonotto 

1  — . -«-l . . J . - . 4 . A 

How  wo  oak  you  to  aklft  your  attention  book  to  tho  moooaga 
pruuoaalnu  jihad*  of  this  vlgnatta,  Mafeoaga  prousaalng  Included 
t**ding,  filiating,  *nd  i  Maying  m*A»§goo  whllo  maintaining  your 
own  owaronaam  of  tha  mltuatiun.  How  demanding  or  difficult  waa 
it  to  l'*  i  f  CI  O  thl*  QVMTAll  Oft  of  H***ag*  plOUiAWlng  IANHaT 

I.  rinii  mUraLp  tho  mental  demand  for  thio  vignette  maaeago 
luouoAAlh g  photo •  Mow  much  mental  and  perceptual  activity  waa 
i»ijoirad  U.g.  i  thinking,  deciding,  calculating,  t  amaidjAi  i ng , 
looking,  avaruhlng,  oto.iT  Haa  the  teak  oAAy  or  damanding, 
aimpia  or  oopploM <  aMauUng  or  fontvlng? 

provide  on  eetieete  of  thle  Vlgnetta'a  tohUI  demand,  overall 
t#*k  difficulty,  liy  ui ruling  tho  appr opr  lata  number  (i-A)  below. 

Vai y  low  Average  Vory  high 

Mohtil  Iwmand  Mental  hMmaiid  kmU)  heeand 

|Mii(itii  «|  <■■■■»»■«,«  ticaJ«H«<iH»aakia4i.Ba».KKii| 

3,  kauond,  eat  1  mate  th*  phyaiuai  demand  fur  thla  vignette 

•AAOAMA  ptOWOAilmi  PhONA.  M«W  MUCll  I'll  V  A  U' A  l  activity  WAA 

raguirad  ( a . y . ,  tiuehing,  Pulling,  turning,  uontrol 1 ino, 
activating,  oti',)?  Wan  tho  teak  a*  ay  or  demanding,  flow  or 
In  Ink,  alack  hi  mtranuoue,  lealful  oi  leboitouaf 
Pi  ov  1  da  an  eeWmate  of  \  ho  fihyalcai  daonnd  you  foil  doling  thla 
vignette 'a  MAAMaga  pioueeiing  pha  aa  hy  olruHno  Hi*  apin opr lato 
Humber  (1*1)  below. 

Vai  y  Uiw  Aval  age  Veiy  High 

khyolual  Demand  Phyalwal  Oeaaml  Phyaloa)  demand 

1  ■  ■*  *■■■•■■!  -•*••»*»**•*  *«li 


MIMMIMIMII  pAAANI  ullAI  N  Only  MOOIMMIUMI 

U)  Ml  (I)  kin  I  Ml  jh  4A  4k  bill  Ain 

<*)  Vlgm  riauMue  A  I  C  D  (4)  Amount l  II  H  L 
(V  f)itA!  ,  {•)  HA 


7X  RADIO  CCD  (Command  and  control  Display) 

Duty  Position:  A06  A21  Subjoct  f  _  Date  _ 

Wa  would  Ilk*  you  to  compare  an  automated  CCD  versus  the  standard 
m  radio  Cor  performing  the  following  command,  control,  and 
communication  (C*)  functions.  We  need  your  assistance.  For  the 
list  of  C1  functions  below,  you  need  to  do  three  things.  First, 
rsad  and  consider  the  C*  function  described. 

flscond,  decide  whether  the  CCD  or  the  FM  radio  would  provide  the 
most  assietmoe  to  you  in  performing  that  function.  Then  circle 
your  answer,  either  CCD  or  radio,  in  the  column  Most  Assistance. 

Third,  consider  how  important  this  function  is  to  you  in  general, 
across  all  situations.  Rate  the  importance  of  each  function  in 
ths  column  Importance  uelng  the  scale  provided  below: 

Hot  Average  Extremely 

Important  Importance  Important 

1“"" - 2 - 3 - 4 - 5 


1 

2 

1 

4 

B 

6 

7 

a 

9 


10. 


n. 


12. 


n. 


Moat 

Assistance  Importance 

(Circle  One)  (Rate  1-5) 


Expressing  message  urgency 

CCD 

RADIO 

Ensuring  stsnderd  message  formats 

CCD 

RADIO 

Ensuring  good  "copy"  of  the  message 

CCD 

RADIO 

Saving/recording  message  contents 

CCD 

RADIO 

Receiving  feedback  message  received 

CCD 

RADIO 

Receiving  operational  overlaya 

CCD 

RADIO 

Issuing  KRAQO  graphics 

CCD 

RADIO 

Linking  reported  locations  to  map 
locations 

CCD 

RADIO 

Keeping  your  eyes  on  the  battlefield 

CCD 

RADIO 

Relaying  messages  received 

CCD 

RADIO 

Maintaining  situational  awareness 

CCD 

RADIO 

Maintaining  map/overlay  alignment 

CCD 

RADIO 

Providing  saay  access  to  map  data 

CCD 

RADIO 
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APPENDIX  F 


TRAINING  AND  TESTING  SCHEDULE 
Training 

7:45-8:00  Participants  at  training/a*sessmant  facility. 

8:00-8:30  Principal  Instructor  present*  overview  brief. 

8:00-8:20  Support  Personnel  (SP)  collect  materials ,  complete 

checklist  to  make  sure  they  have  materials  needed 
&  map  boards  ready.  Breakdown  logs  put  on  SIMs. 

8:20-8:45  Trainers/SP  do  SIM,  CCD  and  radio  checks.  Maks 

sure  CCD  is  ready  to  receive  messages  before  you 
go  to  Demo. 

8:30-8:45  CCD  introduction  in  classroom  using  slides. 

8:45-9:15  Trainers  present  Demo  on  BARCO  monitor. 

SP  at  Demo  to  provide  assistance,  one  to  take 
notes  on  participants  Comments/Questions  asked  for 
training  purposes. 

9:15-9:25  Break 

9:25-10:25  SP  assigned  to  PLs  in  TOC/escort  PLa  out  to  SIM 
SP  present  Structured  Hands-On  Practice 

10:25-10:30  Exercise  set-up/Participants  Break 

10:30-11:05  Exercise  Portion  of  Structured  Practice  for  more 

training  on  message  reception,  relay,  and 
retrieval . 

10:30-10:35  Script  on  Exercise  Procedure  fl 

10:35-10:40  PL  in  SIM/OPORD  provided/headsots  on 

10:40-10:50  Practice  Exercise  fl  (medium  amount  and  relevance) 

10:50-11:00  Situational  Awareness 

11:00-11:05  Feedback  with  SP  in  SIMs 

11:05-11:20  Unstructured  Practice 

11:20-11:25  Supervised  Practice  set-up/Participants  break 

11:25-11:45  Supervised  Practice 

11:25-11:30  Script  for  Exercise  Practice  f2 

11:30-11:35  PL  in  SIM/OPORD  provided/headsets  on 

F-l 


llllft-lll4S 

11141-inoo 

12l00-Ul4S 

12i4D-llOO 

1 21 1 00-*  X 1 00 

liioo-nus 

Dioo-mos 

moi-nno 

mio-unu 

mao-niiQ 

tlllO-llitO 


Praotloa  Kaeroleo  13  (padiua  Mount  and  ralavanaa) 
/■P  fill  out  oh*ukliet/No  SA 

Retraining  with  SP/Peedbaok 

Participant*  Lunch 

Praotloo  Kaeroleo  Preparation 

Lunoh/lP  in  fXMo  at  A i 00  ready  to  go 

Practice  BMoreleo 

•orlpt  for  Raarolaa  Praotloa  fJ 

PL  In  IlM/OPOMD  previded/haadeftta  on 

Kaerolea  Praotloa  I3/0P  fill  out  ohaoHUat 

Situational  Avaranaa* 

Quaationa  and  Anewer 


feet ins 

13l0O“)4i3O  aaaaion  Aa 

OPOMD  review  6  alnutaa 

Maaeag*  prouaaainf  phaio  10  pinuta* 

SA  aaaaaepent  10  pinutaa 

Set-up  for  neat  sNerolaa  I  ainutee 

14 NO-141  SO  Saaalon  S 

14 lOO-ltiOO  Steak 

ltiUQ-lftilo  Saaalon  C 

Itiio-Hioo  Saaalon  0 

iMOO-iTiiu  Maha-upa/praparation  for  neat  day  of  evaluation. 


‘Saaalon  A  euhedult  repeated  for  all  tost  aaaalona. 
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APPENDIX  G 


SAMPLE  OPORD  EXTRACT 


STARTING  SITUATION  -  EXERCISE  1 


Extracts  from  the  OPORD  you  received  last  night  follow  this 
synopsis  of  the  starting  situation. 

STARTING  SYNOPSIS:  Your  unit  has  been  in  contact  with  the  enemy 
for  several  days.  Reconnaissance  units  probed  your  position 
extensively  during  the  previous  evening.  The  battalion  just 
engaged  and  defeated  an  attacking  force  of  unknown  size  and 
composition  and  are  trying  to  discover  the  current  situation. 

You  (for  some  unknown  reason)  were  unable  to  directly  observe  or 
hear  any  of  this  engagement. 

You  and  your  tank  are  now  fully  functional  and  are  trying  to 
gather  information  on  the  engagement  to  pasB  to  your  commander. 
You  have  requested  your  subordinate  elements  provide  you 
information  on  the  engagement.  The  only  means  of  communication 
with  your  higher  or  lower  elements  is  through  your  Command  and 
Control  Display  (CCD) .  You  may  also  be  getting  information  from 
your  higher  headquarters  and  possibly  from  your  adjacent  units 
that  may  be  of  interest  to  your  subordinate  elements. 

EXTRACTS  FROM  LAST  NIGHT'S  OPORD 

ENEMY  SITUATION:  The  enemy  appears  to  be  preparing  to  attack  in 
sector.  Intelligence  has  been  unable  to  determine  the  size  or 
composition  of  the  force  that  may  attack  in  sector. 

FRIENDLY  SITUATION: 

B  company  (LEFT  FLANK) :  Defend  Battle  Position  (BP) 

22.  On  order,  defend  BP  23.  (See  overlay) 

D  Company  (RIGHT  FLANK) :  Defend  BP  42.  On  order, 
defend  BP  43.  (See  overlay) 

MISSION:  A  Company  defend  BP  12.  On  order,  defend  from  BP  13. 
CONCEPT  OP  OPERATION: 

1st  PLT:  Defend  BP  113.  On  order,  defend  from  BP  114. 

3nd  ELI >  Defend  BP  123.  On  order,  defend  from  BP  124. 

jrd  PLT:  Defend  BP  133.  On  order,  defend  from  BP  134. 

SERVICE  SUPPORT  6  COMMAND  AND  SIGNAL:  NOT  INCLUDED 
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APPENDIX  H 


SUMMARY  DATA  ON  INFORMATION  MANAGEMENT  PERFORMANCE 


Table  H-l 

Mean  Percentages  (and  SDs)  on  Message  Processing  Accuracy  by 
Information  Amount  and  Relevance:  Platoon  Leader  Relay 
Performance  versus  Company  Commander  Relay  Ratings 


Measure 

By  Amount 

Low  Relevance 

High  Relevance 

Under  Relays 

Low  Amount 

High  Amount 

4.17  (5.75) 

9.72  (11.01) 

3.69  (7.67) 

15.28  (14.47) 

Over  Relays 

Low  Amount 

High  Amount 

34.72  (21.77) 

16.67  (15.71) 

3.69  (4.85) 

1.39  (3.93) 

Note.  Standard  deviations  in  Darentheses. 

Table  H-2 

Kean  Percentages  (and  SDs)  on  Message  Processing  Accuracy  by 
Information  Amount  and  Relevance:  Platoon  Leader  Relay 
Performance  versus  Own  Relay  Ratings 

Measure 

By  Amount 

Low  Relevance 

High  Relevance 

Under  Relays 

Low  Amount 

High  Amount 

19.44  (22.02) 

19.44  (18.54) 

8.33  (16.53) 

19.44  (14.24) 

Over  Relays 

Low  Amount 

High  Amount 

61.11  (23.00) 

19.44  (38.38) 

44.44  (29.10) 

16.67  (25.89) 

Note.  Standard  deviations  in  parentheses. 
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Tibi*  H-3 

Mean  Tin*  (ami  ID)  In  Seconds  to  Process  Measaoee  ftalayed  froa 
tha  Massive  Queue  toy  Information  Amount  and  Mlavanee 


hula i  I<H  •«  1 4>w  Melevemte,  IIH  »  High  Hslevehut,  Hug  totals  hut 
summing  to  lout  ara  dua  to  rounding-up  aiioie. 


Table  H-5 


Mean  Percentage?  for  Plotting  and  Seeing  Measures  of  situational 
Awareness  by  Information  Amount  and  Relevance  (SDs) 


Percentage 

LRj 

lr2 

HRj 

HR 

2 

Plotting 

LA 

HA 

61.6 

37.6 

(23.9) 

(17.2) 

54.1 

42.0 

(22.8) 

(15.6) 

47.1 

39.3 

(17.0) 

(11.4) 

45.3 

42.3 

(21.6) 

(16.4) 

Seeing 

LA 

HA 

58.  5 
65.8 

(12.8) 

(13.5) 

61.0 

76.0 

(11.8) 

(12.5) 

71.0 

62.5 

(16.7) 

(20.0) 

83.3 

77.8 

(9.6) 

(13.0) 

HflU>  LR  “  Low  Relevance ,  HA  ■  High  Amount. 
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